-- Logs begin at Fri 2022-08-05 19:54:18 UTC, end at Fri 2022-08-05 21:01:09 UTC. -- Aug 05 20:35:26.733180 dv-cinder-852208-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 20:35:26.743562 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 20:35:26.745398 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 20:35:26 2022] *** Aug 05 20:35:26.745398 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 20:35:26.745398 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 20:35:26.745398 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: nodename: dv-cinder-852208-3-iscsi Aug 05 20:35:26.745398 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: machine: x86_64 Aug 05 20:35:26.745398 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: clock source: unix Aug 05 20:35:26.745398 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: pcre jit disabled Aug 05 20:35:26.745398 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: detected number of CPU cores: 4 Aug 05 20:35:26.745398 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: current working directory: / Aug 05 20:35:26.745398 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: detected binary path: /usr/bin/uwsgi-core Aug 05 20:35:26.746124 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: your processes number limit is 47680 Aug 05 20:35:26.746124 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: your memory page size is 4096 bytes Aug 05 20:35:26.746124 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: detected max file descriptor number: 2048 Aug 05 20:35:26.746124 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: lock engine: pthread robust mutexes Aug 05 20:35:26.746124 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: thunder lock: enabled Aug 05 20:35:26.746124 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 20:35:26.746124 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 20:35:26.784333 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: Python main interpreter initialized at 0x5602eca729c0 Aug 05 20:35:26.784333 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: python threads support enabled Aug 05 20:35:26.784333 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: your server socket listen backlog is limited to 100 connections Aug 05 20:35:26.784333 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: your mercy for graceful operations on workers is 90 seconds Aug 05 20:35:26.784683 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 20:35:26.784756 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: *** Operational MODE: preforking *** Aug 05 20:35:26.784993 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: *** uWSGI is running in multiple interpreter mode *** Aug 05 20:35:26.784993 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: spawned uWSGI master process (pid: 109917) Aug 05 20:35:26.785196 dv-cinder-852208-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 20:35:26.785696 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: spawned uWSGI worker 1 (pid: 109918, cores: 1) Aug 05 20:35:26.786043 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: spawned uWSGI worker 2 (pid: 109919, cores: 1) Aug 05 20:35:26.786892 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 20:35:27.430724 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 20:35:27.432935 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 20:35:28.497115 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:35:28.497115 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: from cryptography.utils import int_from_bytes Aug 05 20:35:28.497869 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:35:28.497869 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: from cryptography.utils import int_from_bytes Aug 05 20:35:28.498874 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:35:28.498874 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: from cryptography.utils import int_from_bytes Aug 05 20:35:28.499017 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:35:28.499017 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: from cryptography.utils import int_from_bytes Aug 05 20:35:30.983407 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 20:35:30.983902 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 20:35:30.984183 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 20:35:30.984541 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 20:35:30.984793 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 20:35:30.984975 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 20:35:30.985393 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 20:35:30.985525 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.985525 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.985759 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 20:35:30.985856 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.986011 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 20:35:30.986156 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.986275 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 20:35:30.986406 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.986649 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.986954 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.986954 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.987208 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.987384 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.987530 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.987650 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.987788 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.987909 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.988129 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.988258 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.988387 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.988521 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-3-iscsi {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.988659 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.988787 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.988915 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.989041 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.989186 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.989313 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.989440 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.989608 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.989731 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.989938 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.990076 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-3-iscsi {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.990232 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.990386 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.990508 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.990629 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.990930 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.991111 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.991394 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.991627 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.991839 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.992058 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.992279 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.992496 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.992702 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.993136 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.993136 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.993435 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.993603 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.993743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.993887 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.994030 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.994164 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.994316 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.994511 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.994703 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.994887 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.995087 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.995087 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.995449 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-3-iscsi {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.995619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.995767 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.995952 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.996144 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.996144 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.996459 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.996459 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.996749 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.996749 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.997050 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-3-iscsi {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.997237 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.997378 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.997576 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.997720 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.997878 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.998009 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.998167 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.998370 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.998521 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.998701 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.998832 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.999000 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.999172 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.999291 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.999445 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.999567 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.999721 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.999854 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:30.999985 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.000110 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.000231 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.000360 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.000587 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.000587 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.000840 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.000960 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.001088 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.001218 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.001350 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.001481 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.001601 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.001769 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.001889 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.002017 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.002135 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.002265 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.002385 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.002514 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.002634 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.002753 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.002891 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.003063 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.003192 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.003310 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.003467 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.003589 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.003717 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.003838 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.003966 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.004085 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.004203 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.004337 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.004458 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.004635 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.004752 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.004878 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.005010 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.005147 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.005268 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.005396 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.005515 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.005642 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.005762 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.005894 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.006032 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.006323 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.006442 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.006567 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.006686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.006824 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.006942 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.007062 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.007183 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.007384 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.007528 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.007657 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.007790 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.007910 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.008039 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.008164 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.008292 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.008464 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.008585 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.008707 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.008995 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.009177 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.009321 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.009446 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.009568 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.009694 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.009848 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.010135 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.010347 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.010493 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.010650 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.010783 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.010923 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.011071 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.011201 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.011330 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.011609 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.011731 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.011857 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.012061 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.012190 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.012309 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.012430 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.012551 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.012749 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.012926 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.013051 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.013220 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.013345 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.013465 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.013586 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.013743 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.013876 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.014018 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.014145 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.014266 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.014473 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.014633 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.014777 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.014901 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.015038 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.015172 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.015332 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.015504 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.015643 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.015763 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.015969 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.016144 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.016350 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.016514 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.016638 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.016762 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.016885 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.017008 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.017140 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.017261 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.017384 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.017520 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.017682 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.017803 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.017985 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.018103 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.018269 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.018386 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.018570 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.018709 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.018878 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.019011 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.019178 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.019299 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.019507 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.019647 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.019812 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.019949 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.020108 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.020229 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.020410 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.020529 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.020716 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.020835 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.021006 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.021127 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.021306 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.021438 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.021631 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.021773 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.021927 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.022057 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.022220 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.022355 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.022517 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.022637 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.022816 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.022946 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.023115 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.023269 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.023456 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.023579 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.023745 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.023867 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.024062 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.024202 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.024374 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.024493 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.024682 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.024805 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.024989 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.025110 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.025290 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.025419 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.025615 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.025742 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.025925 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.026073 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.026231 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.026361 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.026536 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.026660 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.026856 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.026994 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.027174 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.027296 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.027515 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.027675 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.027819 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.027938 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.028114 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.028236 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.028439 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:35:31.028583 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.028768 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.028904 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.029076 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.029199 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.029400 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.029540 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.029731 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.029887 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.030071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.030192 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.030409 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.030543 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.030735 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.030865 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.031042 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.031165 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.031387 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.031516 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.031719 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.031928 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.032445 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.032567 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.032727 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.032931 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.033051 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.033186 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.033348 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.033479 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.033608 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.033751 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.033871 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.033993 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.034181 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.034303 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.034509 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.034629 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.034835 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.034966 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.035144 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.035264 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.035485 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.035629 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.035801 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.035931 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.036111 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.036234 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.036420 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.036543 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.036733 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.036889 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.037050 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.037172 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.037381 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.037504 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.037697 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.037845 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.038005 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.038137 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.038317 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.038438 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.038621 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.038741 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.038918 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.039057 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.039220 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.039343 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.039545 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.039666 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.039871 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.040004 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.040184 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.040306 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.040499 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.040620 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.040806 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.040943 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.041116 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.041299 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.041484 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.041616 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.041793 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.041934 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.042099 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.042244 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.042398 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.042524 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.042700 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.042849 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.042997 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.043119 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.043302 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.043475 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.043615 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.043734 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.043930 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.044051 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.044253 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.044385 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.044557 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.044678 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.044867 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.044989 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.045166 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.045286 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.045472 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.045592 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.045774 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.045893 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.046075 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.046207 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.046377 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.046498 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.046684 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.046806 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.046978 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.047110 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.047278 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.047440 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.047624 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.047745 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.047936 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.048068 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.048990 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.049143 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.049143 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.049374 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.049496 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.049496 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.049742 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.049878 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.050003 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.050126 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.050264 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.050394 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.050523 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.050644 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.050766 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.050888 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.051023 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.051141 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.051264 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.051427 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.051556 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.051685 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.051837 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.051977 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.052102 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.052229 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.052352 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.052486 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.052620 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.052735 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.052850 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.053027 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.053323 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.053463 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.053588 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.053707 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.053834 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.053962 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.054088 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.054264 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.054386 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.054587 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.054707 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.054912 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.055032 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.055217 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.055340 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.055553 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.055676 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.055856 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.055990 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.056158 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.056295 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.056459 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.056582 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.056762 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.056941 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.057143 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.057321 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.057501 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.057734 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.057861 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.057998 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.058137 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.058256 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.058399 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.058565 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.058774 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.058925 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.059057 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.059176 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.059298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.059452 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.059577 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.059751 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.059884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.060064 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.060221 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.060354 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.060541 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.060703 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.060865 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.060997 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.061179 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.061344 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.061549 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.061670 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.061795 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.061992 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.062115 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.062318 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.062507 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.062669 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.062800 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.062925 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.063052 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.063239 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.063401 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.063580 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.063705 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.063886 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.064016 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.064195 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.064326 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.064503 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.064637 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.064815 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.064934 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.065115 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.065283 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.065431 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.065563 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.065753 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.065884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.066068 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.066190 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.066380 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.066499 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.066684 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.066805 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.066993 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.067112 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.067308 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.067460 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.067659 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.067786 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.067966 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.068094 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.068273 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.068395 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.068592 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.068746 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.068904 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.069042 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.069203 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.069326 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.069514 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.069647 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.069817 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.069947 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.070132 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.070263 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.070432 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.070565 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.070747 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.070879 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.071050 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.071172 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.071415 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.071579 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.071705 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.071837 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.072022 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.072159 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.072311 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.072487 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.072665 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.072810 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.072985 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.073125 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.073271 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.073403 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.073587 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.073716 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.073887 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.074012 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.074188 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.074310 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.074492 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.074614 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.074801 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.074925 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.075116 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.075248 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.075459 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.075582 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.075766 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.075898 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.076069 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.076191 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.076379 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.076501 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.076678 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.076815 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.076978 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.077099 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.077280 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.077403 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.077590 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.077744 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.077898 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.078019 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.078198 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.078330 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.078501 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.078636 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.078811 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.078932 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.079101 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.079233 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.079437 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.079563 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.079747 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.079884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.080050 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.080171 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.080352 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.080474 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.080667 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.080789 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.080967 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.081090 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.081288 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.081412 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.081604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.081726 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.081903 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.082024 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.082209 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.082329 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.082517 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.082639 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.082819 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.082939 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.083128 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.083251 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.083450 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.083603 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.083784 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.083916 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.084039 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.084164 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.084352 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.084473 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.084659 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.084794 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.084967 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.085100 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.085271 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.085394 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.085590 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.085723 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.085909 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.086033 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.086221 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.086355 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.086538 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.086674 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.086855 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.086977 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.087159 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.087281 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.087492 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.087618 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.087809 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.087940 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.088342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.088479 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.088635 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.088768 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.088896 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.089065 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.089206 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.089379 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.089516 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.089696 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.089822 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.090018 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.090266 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.090479 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.090600 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.090728 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.090909 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.091032 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.091234 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.091396 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.091582 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.091723 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.091883 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.092006 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.092187 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.092319 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.092489 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.092612 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.092798 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.092923 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.093108 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.093291 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.093423 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.093551 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.093691 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.093811 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.093984 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.094167 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.094298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.094435 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.094569 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.094701 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.094860 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.094981 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.095175 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.095330 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.095592 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.095712 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.095837 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.095961 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.096085 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.096236 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.096357 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.096492 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.096662 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.096783 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.096968 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.097105 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.097269 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.097391 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.097570 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.097692 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.097870 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.098000 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.098188 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.098310 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.098490 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.098610 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.098792 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.098914 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.099101 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.099286 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.099429 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.099558 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.099761 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.099883 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.100060 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.100180 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.100380 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.100514 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.100680 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.100801 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.100982 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.101123 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.101286 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.101426 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.101597 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.101731 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.101902 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.102023 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.102200 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.102340 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.102503 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.102625 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.102805 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.102926 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.103112 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.103246 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.103445 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.103588 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.103769 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.103906 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.104055 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.104184 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.104360 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.104500 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.104646 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.104767 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.104960 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.105085 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.105254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.105379 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.105553 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.105676 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.105854 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.106006 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.106165 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.106299 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.106486 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.106618 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.106754 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.106875 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.107046 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.107169 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.107381 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.107525 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.107677 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.107799 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.107977 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.108148 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.108268 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.108403 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.108559 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.108692 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.108866 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.108999 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.109167 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.109350 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.109481 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.109613 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.109750 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.109869 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.110055 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.110190 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.110353 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.110473 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.110661 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.110781 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.110957 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.111077 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.111264 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.111427 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.111597 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.111735 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.111899 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.112031 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.112214 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.112335 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.112510 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.112641 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.112817 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.112938 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.113114 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.113235 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.113419 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.113559 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.113766 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.113890 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.114026 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.114148 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.114285 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.114424 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.114572 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.114704 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.114869 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.115003 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.115170 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.115302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.115494 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.115618 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.115806 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.115928 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.116107 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.116240 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.116407 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.116569 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.116688 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.116811 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.116988 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.117122 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.117307 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.117428 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.117612 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.117732 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.117914 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.118034 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.118252 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.118387 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.118533 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.118658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.118845 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.118966 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.119153 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.119275 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.119573 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.119718 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.119868 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.119999 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.120170 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.120297 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.120483 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.120608 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.120790 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.120912 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.121101 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.121235 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.121406 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.121528 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.121707 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.121829 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.122023 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.122142 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.122331 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.122466 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.122639 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.122760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.122939 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.123058 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.123248 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.123415 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.123600 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.123738 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.123897 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.124035 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.124229 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.124365 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.124488 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.124616 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.124819 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.124939 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.125146 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.125284 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.125449 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.125568 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.125749 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.125881 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.126098 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.126224 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.126348 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.126470 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.126656 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.126778 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.126968 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.127091 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.127266 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.127465 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.127586 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.127709 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.127891 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.128013 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.128195 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.128376 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.128498 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.128638 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.128792 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.128930 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.129091 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.129211 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.129397 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.129535 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.129698 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.129819 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.130002 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.130123 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.130306 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.130443 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.130611 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.130730 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.130922 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.131043 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.131228 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.131390 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.131568 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.131692 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.131877 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.132002 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.132230 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.132366 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.132544 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.132666 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.132857 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.132980 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.133158 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.133281 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.133493 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.133615 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.133816 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.133949 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.134130 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.134309 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.134443 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.134576 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.134724 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.134848 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.135052 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.135216 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.135459 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.135605 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.135781 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.135914 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.136103 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.136241 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.136446 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.136567 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.136756 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.136891 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.137071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.137193 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.137372 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.137502 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.137688 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.137827 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.137996 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.138118 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.138303 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.138483 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.138616 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.138754 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.138924 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.139070 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.139248 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.139389 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.139696 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.139838 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.140014 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.140136 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.140323 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.140474 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.140647 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.140769 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.140951 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.141075 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.141271 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.141393 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.141579 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.141701 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.141904 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.142047 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.142227 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.142351 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.142537 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.142672 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.142851 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.142987 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.143157 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.143280 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.143506 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.143644 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.143833 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.143984 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.144139 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.144275 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.144467 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.144586 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.144732 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.144851 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.145063 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.145185 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.145391 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.145526 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.145747 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.145880 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.146069 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.146203 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.146375 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.146508 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.146678 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.146802 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.146986 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.147118 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.147289 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.147457 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.147619 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.147743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.147941 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.148073 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.148246 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.148393 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.148559 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.148690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.148865 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.148990 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.149175 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.149297 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.149479 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.149603 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.149779 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.149912 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.150087 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.150220 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.150390 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.150549 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.150741 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.150869 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.151192 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.151528 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.151661 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.151788 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.151927 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.152064 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.152196 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.152316 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.152439 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.152633 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.152757 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.152936 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.153055 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.153234 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.153368 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.153539 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.153660 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.153843 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.153966 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.154190 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.154315 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.154499 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.154640 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.154813 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.154936 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.155139 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.155271 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.155488 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.155628 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.155800 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.155934 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.156120 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.156243 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.156440 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.156575 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.156756 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.156881 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.157066 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.157525 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.157721 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.157856 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.158022 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.158144 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.158321 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.158444 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.158630 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.158824 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.158945 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.159074 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.159204 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.159330 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.159508 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.159647 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.159809 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.159950 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.160108 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.160230 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.160438 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.160578 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.160701 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.160829 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.160994 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.161118 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.161295 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.161417 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.161612 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.161732 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.161913 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.162045 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.162214 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.162336 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.162515 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.162639 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.162813 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.162935 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.163127 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.163249 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.163457 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.163581 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.163771 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.163916 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.164074 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.164251 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.164397 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.164520 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.164705 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.164848 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.165009 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.165132 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.165321 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.165497 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.165619 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.165761 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.165924 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.166046 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.166264 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.166395 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.166586 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.166745 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.166891 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.167143 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.167275 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.167489 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.167697 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.167820 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.167954 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.168108 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.168242 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.168473 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.168631 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.168800 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.168958 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.169120 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.169270 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.169580 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.169721 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.169893 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.170015 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.170206 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.170330 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.170515 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.170651 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.170827 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.170952 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.171139 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.171273 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.171472 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.171608 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.171787 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.171927 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.172094 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.172323 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.172473 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.172595 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.172722 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.172848 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.173023 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.173148 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.173341 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.173462 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.173655 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.173791 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.173971 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.174107 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.174291 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.174435 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.174618 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.174804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.174934 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.175083 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.175206 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.175332 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.175557 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.175681 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.175873 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.175995 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.176187 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.176310 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.176496 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.176619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.176803 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.176928 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.177114 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.177237 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.177424 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.177557 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.177727 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.177848 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.178031 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.178153 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.178340 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.178475 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.178647 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.178770 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.178967 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.179111 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.179280 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.179479 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.179606 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.179728 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.179916 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.180039 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.180227 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.180350 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.180542 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.180666 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.180874 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.181059 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.181194 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.181370 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.181493 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.181702 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.182075 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.182229 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.182426 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.182564 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.182732 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.182860 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.183067 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.183205 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.183422 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.183586 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.183747 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.183886 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.184053 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.184189 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.184367 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.184514 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.184670 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.184804 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.184973 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.185127 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.185297 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.185418 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.185581 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.185713 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.185882 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.186018 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.186199 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.186333 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.186506 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.186629 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.186810 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.187032 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.187156 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.187398 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.187525 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.187717 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.187986 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.188120 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.188342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.188466 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.188651 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.188772 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.188958 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.189134 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.189260 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.189407 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.189570 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.189697 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.189870 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.189992 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.190181 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.190314 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.190488 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.190620 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.190788 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.190910 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.191095 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.191225 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.191423 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.191566 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.191731 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.191851 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.192031 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.192151 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.192337 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.192472 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.192638 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.192762 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.192942 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.193087 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.193246 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.193380 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.193548 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.193670 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.193849 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.193970 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.194156 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.194280 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.194460 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.194637 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.194757 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.194880 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.195071 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.195191 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.195326 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.195520 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.195641 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.195764 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.195936 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.196060 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.196244 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.196380 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.196541 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.196671 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.196877 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.196996 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.197129 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.197247 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.197440 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.197728 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.197873 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.198005 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.198135 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.198263 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.198395 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.198534 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.198655 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.198778 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.198955 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.199080 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.199266 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.199450 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.199638 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.199763 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.199958 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.200091 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.200273 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.200410 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.200602 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.200725 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.200916 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.201039 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.201228 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.201440 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.201602 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.201772 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.201895 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.202090 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.202399 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.202535 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.202730 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.202894 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.203038 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.203163 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.203342 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.203499 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.203666 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.203805 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.203988 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.204113 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.204296 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.204419 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.204608 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.204763 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.204912 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.205059 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.205219 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.205354 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.205522 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.205647 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.205830 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.205989 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.206122 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.206257 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.206437 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.206609 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.206731 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.206878 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.207008 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.207138 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.207310 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.207486 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.207622 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.207753 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.207930 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.208053 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.208235 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.208357 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.208547 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.208678 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.208863 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.208997 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.209176 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.209299 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.209488 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.209621 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.209796 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.209931 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.210107 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.210241 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.210413 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.210535 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.210717 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.210840 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.211031 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.211174 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.211348 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.211516 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.211642 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.211782 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.211952 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.212088 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.212264 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.212387 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.212564 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.212686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.212901 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.213055 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.213275 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.213497 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.213648 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.214004 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.214224 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.214438 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.214584 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.214664 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.214797 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.214964 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.215097 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.215290 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.215436 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.215636 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.215765 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.215956 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.216093 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.216264 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.216407 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.216598 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.216738 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.216922 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.217053 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.217249 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.217388 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.217572 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.217734 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.217877 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.218068 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.218180 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.218400 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.218485 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.218710 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.218804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.219023 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.219116 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.219331 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.219491 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.219666 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.219757 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.219960 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.220051 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.220267 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.220359 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.220569 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.220655 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.220870 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.220954 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.221165 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.221248 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.221464 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.221550 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.221767 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.221851 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.222060 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.222143 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.222361 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.222447 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.222659 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.222744 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.222958 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.223050 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.223254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.223346 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.223575 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.223673 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.223878 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.223980 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.224172 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.224256 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.224472 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.224555 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.224765 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.224858 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.225067 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.225153 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.225363 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.225449 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.225664 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.225830 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.225972 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.226100 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.226277 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.226418 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.226613 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.226742 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.226947 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.227032 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.227266 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.227351 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.227619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.227707 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.227935 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.228028 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.228262 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.228347 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.228571 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.228691 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.228953 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.229140 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.229304 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.229543 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.229685 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.229869 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.229968 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.230175 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.230272 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.230482 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.230569 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.230788 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.230873 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.231100 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.231185 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.231446 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.231537 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.231761 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.231847 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.232061 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.232153 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.232375 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.232461 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.232686 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.232780 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.233005 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.233099 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.233315 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.233400 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.233619 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.233703 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.233947 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.234041 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.234255 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.234341 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.234563 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.234649 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.234872 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.234966 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.235182 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.235271 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.235514 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.235616 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.235825 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.235911 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.236128 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.236225 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.236436 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.236531 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.236747 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.236840 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.237056 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.237141 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.237366 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.237451 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.237682 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.237768 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.237985 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.238076 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.238303 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.238395 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.238622 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.238706 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.238947 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.239038 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.239261 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.239376 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.239611 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.239708 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.239938 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.240023 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.240249 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.240348 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.240558 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.240644 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.240863 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.240962 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.241104 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 20:35:31.241228 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.241547 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.241863 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.242170 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:35:31.242417 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 20:35:31.397487 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO dbcounter [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] Registered counter for database nova_api Aug 05 20:35:31.397977 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO dbcounter [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Registered counter for database nova_api Aug 05 20:35:31.420304 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG oslo_db.sqlalchemy.engines [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:35:31.422240 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_db.sqlalchemy.engines [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:35:31.427911 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG dbcounter [-] [109919] Writer thread running {{(pid=109919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:35:31.429228 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG dbcounter [-] [109918] Writer thread running {{(pid=109918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:35:31.484062 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.context [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa2e0ab0-e014-4390-9eb9-f79d2e1db09c(cell1) {{(pid=109919) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 20:35:31.487268 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.context [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa2e0ab0-e014-4390-9eb9-f79d2e1db09c(cell1) {{(pid=109918) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 20:35:31.487963 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG oslo_concurrency.lockutils [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:35:31.488437 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG oslo_concurrency.lockutils [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:35:31.489978 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG oslo_concurrency.lockutils [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:35:31.490694 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG oslo_concurrency.lockutils [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:35:31.491128 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG oslo_concurrency.lockutils [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:35:31.491262 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:35:31.491648 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:35:31.493119 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG oslo_concurrency.lockutils [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:35:31.493255 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:35:31.493921 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:35:31.494406 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:35:31.495175 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO dbcounter [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] Registered counter for database nova_cell0 Aug 05 20:35:31.496920 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:35:31.498911 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO dbcounter [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Registered counter for database nova_cell0 Aug 05 20:35:31.500592 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO dbcounter [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] Registered counter for database nova_cell1 Aug 05 20:35:31.504338 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO dbcounter [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Registered counter for database nova_cell1 Aug 05 20:35:31.509829 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG oslo_db.sqlalchemy.engines [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:35:31.514472 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_db.sqlalchemy.engines [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:35:31.514640 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG oslo_db.sqlalchemy.engines [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:35:31.515875 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_db.sqlalchemy.engines [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:35:31.518857 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG dbcounter [-] [109918] Writer thread running {{(pid=109918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:35:31.519021 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG dbcounter [-] [109919] Writer thread running {{(pid=109919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:35:31.521341 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG dbcounter [-] [109919] Writer thread running {{(pid=109919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:35:31.657552 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG dbcounter [-] [109918] Writer thread running {{(pid=109918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:35:31.665737 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO dbcounter [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] Registered counter for database nova_cell0 Aug 05 20:35:31.666871 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO dbcounter [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Registered counter for database nova_cell0 Aug 05 20:35:31.676097 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG oslo_db.sqlalchemy.engines [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:35:31.680936 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_db.sqlalchemy.engines [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:35:31.684164 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG dbcounter [-] [109919] Writer thread running {{(pid=109919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:35:31.686510 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG dbcounter [-] [109918] Writer thread running {{(pid=109918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:35:32.020741 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: WARNING keystonemiddleware.auth_token [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:35:32.024255 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: WARNING keystonemiddleware.auth_token [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:35:32.028201 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: WARNING keystonemiddleware.auth_token [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:35:32.031596 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: WARNING keystonemiddleware.auth_token [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:35:32.369688 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: WARNING keystonemiddleware.auth_token [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:35:32.375801 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: WARNING keystonemiddleware.auth_token [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:35:32.376260 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: WARNING keystonemiddleware.auth_token [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:35:32.381060 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602eca729c0 pid: 109918 (default app) Aug 05 20:35:32.382303 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: WARNING keystonemiddleware.auth_token [None req-7a6e4b1b-bd41-4afa-8264-01372501705d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:35:32.383162 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:35:32.384378 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] 10.222.0.100 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001770 Aug 05 20:35:32.384767 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 1/1] 10.222.0.100 () {50 vars in 793 bytes} [Fri Aug 5 20:35:32 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:35:32.387838 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602eca729c0 pid: 109919 (default app) Aug 05 20:36:48.574864 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:36:48.576034 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001884 Aug 05 20:36:48.576429 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 2/2] 10.222.0.100 () {54 vars in 936 bytes} [Fri Aug 5 20:36:48 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:36:48.589152 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG dbcounter [-] [109919] Writing DB stats nova_api:SELECT=3 {{(pid=109919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:48.590670 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG dbcounter [-] [109919] Writing DB stats nova_cell0:SELECT=3 {{(pid=109919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:48.591575 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG dbcounter [-] [109919] Writing DB stats nova_cell1:SELECT=3 {{(pid=109919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:48.592988 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG dbcounter [-] [109919] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:49.501784 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-1e2e1482-d46a-4a8b-8ff0-f8a75180e60b admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:36:49.538870 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-1e2e1482-d46a-4a8b-8ff0-f8a75180e60b admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.955096 Aug 05 20:36:49.539860 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 1/3] 10.222.0.100 () {60 vars in 1297 bytes} [Fri Aug 5 20:36:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:36:51.772714 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:36:51.773658 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-84b191ac-5046-46ba-bc51-c729b8997d55 None None] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001433 Aug 05 20:36:51.774227 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 3/4] 10.222.0.100 () {54 vars in 936 bytes} [Fri Aug 5 20:36:51 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:36:52.216741 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-fc9d5b60-df4d-49db-b2cb-ba5413113871 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "ram": 256}} {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:36:52.236611 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:36:52.236611 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: warnings.warn(msg) Aug 05 20:36:52.266711 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-fc9d5b60-df4d-49db-b2cb-ba5413113871 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.486006 Aug 05 20:36:52.267352 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 2/5] 10.222.0.100 () {64 vars in 1288 bytes} [Fri Aug 5 20:36:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:36:52.282063 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG dbcounter [-] [109918] Writing DB stats nova_api:SELECT=3 {{(pid=109918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:52.283560 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG dbcounter [-] [109918] Writing DB stats nova_cell0:SELECT=3 {{(pid=109918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:52.284516 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG dbcounter [-] [109918] Writing DB stats nova_cell1:SELECT=3 {{(pid=109918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:52.285550 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG dbcounter [-] [109918] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:36:52.492365 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-3b537599-1d00-45f6-aeea-63da2766d8ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:36:52.497152 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:36:52.497152 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: warnings.warn(msg) Aug 05 20:36:52.566672 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-3b537599-1d00-45f6-aeea-63da2766d8ef admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290122 Aug 05 20:36:52.567747 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 4/6] 10.222.0.100 () {64 vars in 1341 bytes} [Fri Aug 5 20:36:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:36:54.777984 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-fc9d5b60-df4d-49db-b2cb-ba5413113871 admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:36:54.779013 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-fc9d5b60-df4d-49db-b2cb-ba5413113871 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001489 Aug 05 20:36:54.779616 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 3/7] 10.222.0.100 () {54 vars in 936 bytes} [Fri Aug 5 20:36:54 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:36:55.439758 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-52391f18-869a-427b-97cd-dee898e9626f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:36:55.458980 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:36:55.458980 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: warnings.warn(msg) Aug 05 20:36:55.480496 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-52391f18-869a-427b-97cd-dee898e9626f admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.694336 Aug 05 20:36:55.481470 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 5/8] 10.222.0.100 () {64 vars in 1288 bytes} [Fri Aug 5 20:36:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:36:55.493406 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-81a116fc-48cc-45c0-9c1c-a2a715d7ccdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:36:55.496473 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:36:55.496473 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: warnings.warn(msg) Aug 05 20:36:55.532341 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-81a116fc-48cc-45c0-9c1c-a2a715d7ccdd admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042479 Aug 05 20:36:55.543386 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 4/9] 10.222.0.100 () {64 vars in 1341 bytes} [Fri Aug 5 20:36:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:36:57.827054 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-52391f18-869a-427b-97cd-dee898e9626f admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:36:57.828822 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-52391f18-869a-427b-97cd-dee898e9626f admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002495 Aug 05 20:36:57.829497 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 6/10] 10.222.0.100 () {54 vars in 936 bytes} [Fri Aug 5 20:36:57 2022] GET /compute/v2.1 => generated 389 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:36:58.263562 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-5d476bb9-d4b4-4719-8e3a-6ba86402940d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0}} {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:36:58.283452 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-5d476bb9-d4b4-4719-8e3a-6ba86402940d admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.445036 Aug 05 20:36:58.284008 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 5/11] 10.222.0.100 () {64 vars in 1288 bytes} [Fri Aug 5 20:36:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:36:58.296098 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-9ccefad9-d542-47a3-b239-04554514f6e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:36:58.322553 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-9ccefad9-d542-47a3-b239-04554514f6e6 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030208 Aug 05 20:36:58.323570 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 7/12] 10.222.0.100 () {64 vars in 1341 bytes} [Fri Aug 5 20:36:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:37:00.538618 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-5d476bb9-d4b4-4719-8e3a-6ba86402940d admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:00.539574 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-5d476bb9-d4b4-4719-8e3a-6ba86402940d admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001475 Aug 05 20:37:00.539980 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 6/13] 10.222.0.100 () {54 vars in 936 bytes} [Fri Aug 5 20:37:00 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:01.025639 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-1ad64f9e-f7f1-431e-af65-dac3a97d1341 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "ram": 2048}} {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:01.047658 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-1ad64f9e-f7f1-431e-af65-dac3a97d1341 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.501680 Aug 05 20:37:01.048109 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 8/14] 10.222.0.100 () {64 vars in 1288 bytes} [Fri Aug 5 20:37:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:37:01.061127 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-1c8c8e8f-3082-4af7-a496-2a0eb7482f5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:01.086738 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-1c8c8e8f-3082-4af7-a496-2a0eb7482f5d admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029820 Aug 05 20:37:01.087608 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 7/15] 10.222.0.100 () {64 vars in 1341 bytes} [Fri Aug 5 20:37:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:37:03.294112 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-1ad64f9e-f7f1-431e-af65-dac3a97d1341 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:03.295131 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-1ad64f9e-f7f1-431e-af65-dac3a97d1341 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001441 Aug 05 20:37:03.299782 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 9/16] 10.222.0.100 () {54 vars in 936 bytes} [Fri Aug 5 20:37:03 2022] GET /compute/v2.1 => generated 389 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:03.789727 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-24d22550-b778-436f-86c4-12317c86a1ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4"}} {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:03.821529 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-24d22550-b778-436f-86c4-12317c86a1ee admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.518962 Aug 05 20:37:03.840209 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-51d6a154-57c7-4485-bbac-f8a8130fde52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:03.844520 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 8/17] 10.222.0.100 () {64 vars in 1288 bytes} [Fri Aug 5 20:37:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:37:03.867712 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-51d6a154-57c7-4485-bbac-f8a8130fde52 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031908 Aug 05 20:37:03.868585 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 10/18] 10.222.0.100 () {64 vars in 1341 bytes} [Fri Aug 5 20:37:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:37:06.055447 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-24d22550-b778-436f-86c4-12317c86a1ee admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:06.056797 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-24d22550-b778-436f-86c4-12317c86a1ee admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001779 Aug 05 20:37:06.057308 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 9/19] 10.222.0.100 () {54 vars in 936 bytes} [Fri Aug 5 20:37:06 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:06.497414 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-28ef573a-e281-4f83-aac3-db8ed08641f6 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:06.522012 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-28ef573a-e281-4f83-aac3-db8ed08641f6 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.457923 Aug 05 20:37:06.522561 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 11/20] 10.222.0.100 () {60 vars in 1297 bytes} [Fri Aug 5 20:37:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:37:08.752425 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-24d22550-b778-436f-86c4-12317c86a1ee admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:08.754734 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-24d22550-b778-436f-86c4-12317c86a1ee admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.003799 Aug 05 20:37:08.755426 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 10/21] 10.222.0.100 () {54 vars in 936 bytes} [Fri Aug 5 20:37:08 2022] GET /compute/v2.1 => generated 389 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:09.254241 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-61564390-3281-4f4b-b236-5562502e18f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:09.274770 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-61564390-3281-4f4b-b236-5562502e18f6 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.512225 Aug 05 20:37:09.275353 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 12/22] 10.222.0.100 () {64 vars in 1288 bytes} [Fri Aug 5 20:37:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:37:09.288467 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-94c45067-4bdd-4e16-9f47-9dcae7c747d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:09.313517 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-94c45067-4bdd-4e16-9f47-9dcae7c747d0 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028831 Aug 05 20:37:09.314115 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 11/23] 10.222.0.100 () {64 vars in 1338 bytes} [Fri Aug 5 20:37:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:37:11.544583 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-61564390-3281-4f4b-b236-5562502e18f6 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:11.545632 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-61564390-3281-4f4b-b236-5562502e18f6 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001501 Aug 05 20:37:11.546038 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 13/24] 10.222.0.100 () {54 vars in 936 bytes} [Fri Aug 5 20:37:11 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:11.968516 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-664b7fec-0879-4d74-9c73-b7346e7b192f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:11.989524 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-664b7fec-0879-4d74-9c73-b7346e7b192f admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.437024 Aug 05 20:37:11.990098 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 12/25] 10.222.0.100 () {64 vars in 1288 bytes} [Fri Aug 5 20:37:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:37:12.002538 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-e1409b05-0bd6-4bf0-bfab-68ead4233f3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:12.029507 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-e1409b05-0bd6-4bf0-bfab-68ead4233f3d admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030741 Aug 05 20:37:12.030088 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 14/26] 10.222.0.100 () {64 vars in 1338 bytes} [Fri Aug 5 20:37:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:37:14.193904 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-664b7fec-0879-4d74-9c73-b7346e7b192f admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:14.194918 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-664b7fec-0879-4d74-9c73-b7346e7b192f admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001444 Aug 05 20:37:14.195331 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 13/27] 10.222.0.100 () {54 vars in 936 bytes} [Fri Aug 5 20:37:14 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:14.572709 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-9496ec6d-cb70-40e9-b40e-04c0ede62728 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "3", "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "disk": 40}} {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:14.592618 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-9496ec6d-cb70-40e9-b40e-04c0ede62728 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.391076 Aug 05 20:37:14.593300 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 15/28] 10.222.0.100 () {64 vars in 1288 bytes} [Fri Aug 5 20:37:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:37:14.605742 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-9990adc5-1a7d-4092-ad4c-812fb4f76824 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:14.635550 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-9990adc5-1a7d-4092-ad4c-812fb4f76824 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033606 Aug 05 20:37:14.636877 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 14/29] 10.222.0.100 () {64 vars in 1338 bytes} [Fri Aug 5 20:37:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:37:16.877323 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-9496ec6d-cb70-40e9-b40e-04c0ede62728 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:16.878344 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-9496ec6d-cb70-40e9-b40e-04c0ede62728 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001505 Aug 05 20:37:16.878755 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 16/30] 10.222.0.100 () {54 vars in 936 bytes} [Fri Aug 5 20:37:16 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:17.368910 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-163b90ad-c7ba-4def-a31c-b9282180f6ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "disk": 80, "vcpus": 4}} {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:17.390329 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-163b90ad-c7ba-4def-a31c-b9282180f6ae admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.505485 Aug 05 20:37:17.390887 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 15/31] 10.222.0.100 () {64 vars in 1288 bytes} [Fri Aug 5 20:37:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:37:17.403312 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-c1974e40-b5f2-46c4-a7ec-a736b503d7f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:17.429745 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-c1974e40-b5f2-46c4-a7ec-a736b503d7f1 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030484 Aug 05 20:37:17.430332 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 17/32] 10.222.0.100 () {64 vars in 1338 bytes} [Fri Aug 5 20:37:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:37:19.708931 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-163b90ad-c7ba-4def-a31c-b9282180f6ae admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:19.710395 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-163b90ad-c7ba-4def-a31c-b9282180f6ae admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002464 Aug 05 20:37:19.711240 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 16/33] 10.222.0.100 () {54 vars in 936 bytes} [Fri Aug 5 20:37:19 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:20.162240 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-600965c0-0743-4f03-9bd0-26005e42de71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 160, "ram": 16384, "vcpus": 8}} {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:20.181584 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-600965c0-0743-4f03-9bd0-26005e42de71 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.463315 Aug 05 20:37:20.182167 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 18/34] 10.222.0.100 () {64 vars in 1288 bytes} [Fri Aug 5 20:37:19 2022] POST /compute/v2.1/flavors => generated 410 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:37:20.198051 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-b49cd0a0-659c-4d16-93fc-ced4ca96c168 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:20.203493 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG dbcounter [-] [109919] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:20.234211 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-b49cd0a0-659c-4d16-93fc-ced4ca96c168 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040834 Aug 05 20:37:20.234211 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 17/35] 10.222.0.100 () {64 vars in 1338 bytes} [Fri Aug 5 20:37:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:37:41.239737 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-600965c0-0743-4f03-9bd0-26005e42de71 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:41.240897 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-600965c0-0743-4f03-9bd0-26005e42de71 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001941 Aug 05 20:37:41.241391 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 19/36] 10.222.0.100 () {54 vars in 936 bytes} [Fri Aug 5 20:37:41 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:41.677857 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-6ca43195-e4aa-4eae-8eee-c93c85239122 admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:41.697043 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-6ca43195-e4aa-4eae-8eee-c93c85239122 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.445665 Aug 05 20:37:41.697617 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 18/37] 10.222.0.100 () {60 vars in 1297 bytes} [Fri Aug 5 20:37:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:37:42.805752 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-600965c0-0743-4f03-9bd0-26005e42de71 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:42.806973 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-600965c0-0743-4f03-9bd0-26005e42de71 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002015 Aug 05 20:37:42.807516 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 20/38] 10.222.0.100 () {56 vars in 1079 bytes} [Fri Aug 5 20:37:42 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:43.382340 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-8f10f6e9-b1fa-40c7-af65-db52826fd68f admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:43.388370 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.wsgi [None req-8f10f6e9-b1fa-40c7-af65-db52826fd68f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-8f10f6e9-b1fa-40c7-af65-db52826fd68f admin admin] Request method failure captured: Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Accept: application/json Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Accept-Encoding: gzip, deflate Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Connection: keep-alive Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Content-Length: 0 Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Host: 10.222.0.100 Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Openstack-Api-Version: compute 2.90 Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Openstack-System-Scope: None Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: User-Agent: python-novaclient Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Auth-Token: gAAAAABi7X-Wf02qSOZgDmFVUE4HC3GcGQ-iS8Rz_olHCEzb_9C8G4dcdDrVFCeQfjIhPodtLXUWn0ThSKPjVfkrJzz8tijJ7SjdCfcKxpUUOFCFlE_pnj26-mn9pYRzYD_fbmm6nX6-i5V1weE7C_iCj-rV_QafmU89_zk0VQprdlon2-XW_Ig Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Domain-Id: None Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Domain-Name: None Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Identity-Status: Confirmed Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Is-Admin-Project: True Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Project-Domain-Id: default Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Project-Domain-Name: Default Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Project-Id: abb569dd63634bd9bd1193603cb21bb9 Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Project-Name: admin Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Role: member,admin,reader Aug 05 20:37:43.391658 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Roles: member,admin,reader Aug 05 20:37:43.393254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_abb569dd63634bd9bd1193603cb21bb9", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:37:43.393254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Tenant: admin Aug 05 20:37:43.393254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Tenant-Id: abb569dd63634bd9bd1193603cb21bb9 Aug 05 20:37:43.393254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Tenant-Name: admin Aug 05 20:37:43.393254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User: admin Aug 05 20:37:43.393254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User-Domain-Id: default Aug 05 20:37:43.393254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User-Domain-Name: Default Aug 05 20:37:43.393254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User-Id: 08fbb9e763104d83ac22d69bcd83fff2 Aug 05 20:37:43.393254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User-Name: admin Aug 05 20:37:43.393254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: method: > Aug 05 20:37:43.393254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: exception: Flavor 42 could not be found. Aug 05 20:37:43.393254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: action_args: {'id': '42'} Aug 05 20:37:43.393254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:37:43.393254 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:37:43.394282 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:43.395804 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-8f10f6e9-b1fa-40c7-af65-db52826fd68f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:37:43.397141 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-8f10f6e9-b1fa-40c7-af65-db52826fd68f admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.442148 Aug 05 20:37:43.397141 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 19/39] 10.222.0.100 () {60 vars in 1195 bytes} [Fri Aug 5 20:37:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 444 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:43.403321 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-61fd32a3-ebbc-4da3-9e44-9c45a2e7c69e admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:43.407572 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG dbcounter [-] [109918] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:37:43.427626 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-61fd32a3-ebbc-4da3-9e44-9c45a2e7c69e admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.028185 Aug 05 20:37:43.428185 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 21/40] 10.222.0.100 () {60 vars in 1215 bytes} [Fri Aug 5 20:37:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:37:43.438427 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-15cbaa3b-c633-4c07-932d-a0c80020c64d admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:43.462306 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-15cbaa3b-c633-4c07-932d-a0c80020c64d admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027528 Aug 05 20:37:43.462843 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 20/41] 10.222.0.100 () {60 vars in 1215 bytes} [Fri Aug 5 20:37:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:37:43.472704 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-fee577e3-c22a-4006-a839-746e860fdbb4 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:43.479294 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.wsgi [None req-fee577e3-c22a-4006-a839-746e860fdbb4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-fee577e3-c22a-4006-a839-746e860fdbb4 admin admin] Request method failure captured: Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Accept: application/json Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Accept-Encoding: gzip, deflate Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Connection: keep-alive Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Content-Length: 0 Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Host: 10.222.0.100 Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Openstack-Api-Version: compute 2.90 Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Openstack-System-Scope: None Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: User-Agent: python-novaclient Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Auth-Token: gAAAAABi7X-Wf02qSOZgDmFVUE4HC3GcGQ-iS8Rz_olHCEzb_9C8G4dcdDrVFCeQfjIhPodtLXUWn0ThSKPjVfkrJzz8tijJ7SjdCfcKxpUUOFCFlE_pnj26-mn9pYRzYD_fbmm6nX6-i5V1weE7C_iCj-rV_QafmU89_zk0VQprdlon2-XW_Ig Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Domain-Id: None Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Domain-Name: None Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Identity-Status: Confirmed Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Is-Admin-Project: True Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Project-Domain-Id: default Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Project-Domain-Name: Default Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Project-Id: abb569dd63634bd9bd1193603cb21bb9 Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Project-Name: admin Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Role: member,admin,reader Aug 05 20:37:43.482619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Roles: member,admin,reader Aug 05 20:37:43.484198 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_abb569dd63634bd9bd1193603cb21bb9", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:37:43.484198 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Tenant: admin Aug 05 20:37:43.484198 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Tenant-Id: abb569dd63634bd9bd1193603cb21bb9 Aug 05 20:37:43.484198 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Tenant-Name: admin Aug 05 20:37:43.484198 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User: admin Aug 05 20:37:43.484198 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User-Domain-Id: default Aug 05 20:37:43.484198 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User-Domain-Name: Default Aug 05 20:37:43.484198 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User-Id: 08fbb9e763104d83ac22d69bcd83fff2 Aug 05 20:37:43.484198 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User-Name: admin Aug 05 20:37:43.484198 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: method: > Aug 05 20:37:43.484198 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: exception: Flavor 42 could not be found. Aug 05 20:37:43.484198 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: action_args: {'id': '42'} Aug 05 20:37:43.484198 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:37:43.484198 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:37:43.485071 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:43.486096 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-fee577e3-c22a-4006-a839-746e860fdbb4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:37:43.487134 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-fee577e3-c22a-4006-a839-746e860fdbb4 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015023 Aug 05 20:37:43.487134 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 22/42] 10.222.0.100 () {60 vars in 1195 bytes} [Fri Aug 5 20:37:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:44.460028 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-15cbaa3b-c633-4c07-932d-a0c80020c64d admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:44.461081 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-15cbaa3b-c633-4c07-932d-a0c80020c64d admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001531 Aug 05 20:37:44.461476 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 21/43] 10.222.0.100 () {56 vars in 1079 bytes} [Fri Aug 5 20:37:44 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:37:45.034153 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-8208bdd2-a54f-4ad9-841f-c163575c4125 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:45.039650 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.wsgi [None req-8208bdd2-a54f-4ad9-841f-c163575c4125 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-8208bdd2-a54f-4ad9-841f-c163575c4125 admin admin] Request method failure captured: Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Accept: application/json Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Accept-Encoding: gzip, deflate Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Connection: keep-alive Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Content-Length: 0 Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Host: 10.222.0.100 Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Openstack-Api-Version: compute 2.90 Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Openstack-System-Scope: None Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: User-Agent: python-novaclient Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Auth-Token: gAAAAABi7X-Yg6hFnB4yNceFgcNl_ivxcP1nKRFCZw-lAeuMJLBz9Neh4OZyp3eWItGiqm9PdoKyH4BI97u7seveiD_9sUa5qsOwu3bbE-XyTKu1tdzYOY3EMBkX34Pp1RKzhCAd2rvHxMF753yH6wC_zxkTSmELkSblCVJI3Li_-ltUMEFr1R0 Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Domain-Id: None Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Domain-Name: None Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Identity-Status: Confirmed Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Is-Admin-Project: True Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Project-Domain-Id: default Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Project-Domain-Name: Default Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Project-Id: abb569dd63634bd9bd1193603cb21bb9 Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Project-Name: admin Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Role: member,admin,reader Aug 05 20:37:45.041197 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Roles: member,admin,reader Aug 05 20:37:45.042743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_abb569dd63634bd9bd1193603cb21bb9", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:37:45.042743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Tenant: admin Aug 05 20:37:45.042743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Tenant-Id: abb569dd63634bd9bd1193603cb21bb9 Aug 05 20:37:45.042743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Tenant-Name: admin Aug 05 20:37:45.042743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User: admin Aug 05 20:37:45.042743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User-Domain-Id: default Aug 05 20:37:45.042743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User-Domain-Name: Default Aug 05 20:37:45.042743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User-Id: 08fbb9e763104d83ac22d69bcd83fff2 Aug 05 20:37:45.042743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User-Name: admin Aug 05 20:37:45.042743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: method: > Aug 05 20:37:45.042743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: exception: Flavor 84 could not be found. Aug 05 20:37:45.042743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: action_args: {'id': '84'} Aug 05 20:37:45.042743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:37:45.042743 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:37:45.043604 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:45.044690 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-8208bdd2-a54f-4ad9-841f-c163575c4125 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:37:45.045678 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-8208bdd2-a54f-4ad9-841f-c163575c4125 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.445758 Aug 05 20:37:45.045678 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 23/44] 10.222.0.100 () {60 vars in 1195 bytes} [Fri Aug 5 20:37:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:45.052715 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-b12206a3-84e7-4e5c-8641-d0f829a2c9ef admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:45.068233 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-b12206a3-84e7-4e5c-8641-d0f829a2c9ef admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019127 Aug 05 20:37:45.068809 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 22/45] 10.222.0.100 () {60 vars in 1215 bytes} [Fri Aug 5 20:37:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:37:45.080088 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-5c2a21c5-e61c-4407-a24a-baa0b70553d9 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:45.102772 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-5c2a21c5-e61c-4407-a24a-baa0b70553d9 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027269 Aug 05 20:37:45.103464 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 24/46] 10.222.0.100 () {60 vars in 1215 bytes} [Fri Aug 5 20:37:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:37:45.113776 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-75d1c814-8105-4945-b2e9-8b550a414f6f admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:45.119182 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.wsgi [None req-75d1c814-8105-4945-b2e9-8b550a414f6f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-75d1c814-8105-4945-b2e9-8b550a414f6f admin admin] Request method failure captured: Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Accept: application/json Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Accept-Encoding: gzip, deflate Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Connection: keep-alive Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Content-Length: 0 Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Host: 10.222.0.100 Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Openstack-Api-Version: compute 2.90 Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Openstack-System-Scope: None Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: User-Agent: python-novaclient Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Auth-Token: gAAAAABi7X-Yg6hFnB4yNceFgcNl_ivxcP1nKRFCZw-lAeuMJLBz9Neh4OZyp3eWItGiqm9PdoKyH4BI97u7seveiD_9sUa5qsOwu3bbE-XyTKu1tdzYOY3EMBkX34Pp1RKzhCAd2rvHxMF753yH6wC_zxkTSmELkSblCVJI3Li_-ltUMEFr1R0 Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Domain-Id: None Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Domain-Name: None Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Identity-Status: Confirmed Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Is-Admin-Project: True Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Project-Domain-Id: default Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Project-Domain-Name: Default Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Project-Id: abb569dd63634bd9bd1193603cb21bb9 Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Project-Name: admin Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Role: member,admin,reader Aug 05 20:37:45.121317 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Roles: member,admin,reader Aug 05 20:37:45.122884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_abb569dd63634bd9bd1193603cb21bb9", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:37:45.122884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Tenant: admin Aug 05 20:37:45.122884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Tenant-Id: abb569dd63634bd9bd1193603cb21bb9 Aug 05 20:37:45.122884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Tenant-Name: admin Aug 05 20:37:45.122884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User: admin Aug 05 20:37:45.122884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User-Domain-Id: default Aug 05 20:37:45.122884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User-Domain-Name: Default Aug 05 20:37:45.122884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User-Id: 08fbb9e763104d83ac22d69bcd83fff2 Aug 05 20:37:45.122884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User-Name: admin Aug 05 20:37:45.122884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: method: > Aug 05 20:37:45.122884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: exception: Flavor 84 could not be found. Aug 05 20:37:45.122884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: action_args: {'id': '84'} Aug 05 20:37:45.122884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:37:45.122884 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:37:45.123852 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:45.125298 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-75d1c814-8105-4945-b2e9-8b550a414f6f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:37:45.126548 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-75d1c814-8105-4945-b2e9-8b550a414f6f admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012510 Aug 05 20:37:45.126548 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 23/47] 10.222.0.100 () {60 vars in 1195 bytes} [Fri Aug 5 20:37:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:46.239114 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-5c2a21c5-e61c-4407-a24a-baa0b70553d9 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:46.240140 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-5c2a21c5-e61c-4407-a24a-baa0b70553d9 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001480 Aug 05 20:37:46.240535 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 25/48] 10.222.0.100 () {56 vars in 1079 bytes} [Fri Aug 5 20:37:46 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:46.836976 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-2fd7b755-47a3-45f7-89a7-112c4bee411d admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:46.843284 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.wsgi [None req-2fd7b755-47a3-45f7-89a7-112c4bee411d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-2fd7b755-47a3-45f7-89a7-112c4bee411d admin admin] Request method failure captured: Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Accept: application/json Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Accept-Encoding: gzip, deflate Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Connection: keep-alive Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Content-Length: 0 Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Host: 10.222.0.100 Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Openstack-Api-Version: compute 2.90 Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Openstack-System-Scope: None Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: User-Agent: python-novaclient Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Auth-Token: gAAAAABi7X-aGleljkv2irz0p2aefzZa7RWucrlHZSFoH-SrSZY-kr97cOce6E8hRLKKTYbEwQhDQCfsHPwxGc-d6h9YYmpO8nxVN0V07q-pRiJbf54H3MTBI8My7X8yIMDxhtP1-sZkLiWdr0pmZb3T9-WMgQgzK46WtnncMIJZ-Vt2O_rVSgk Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Domain-Id: None Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Domain-Name: None Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Identity-Status: Confirmed Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Is-Admin-Project: True Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Project-Domain-Id: default Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Project-Domain-Name: Default Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Project-Id: abb569dd63634bd9bd1193603cb21bb9 Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Project-Name: admin Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Role: member,admin,reader Aug 05 20:37:46.844831 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Roles: member,admin,reader Aug 05 20:37:46.846358 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_abb569dd63634bd9bd1193603cb21bb9", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:37:46.846358 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Tenant: admin Aug 05 20:37:46.846358 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Tenant-Id: abb569dd63634bd9bd1193603cb21bb9 Aug 05 20:37:46.846358 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-Tenant-Name: admin Aug 05 20:37:46.846358 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User: admin Aug 05 20:37:46.846358 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User-Domain-Id: default Aug 05 20:37:46.846358 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User-Domain-Name: Default Aug 05 20:37:46.846358 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User-Id: 08fbb9e763104d83ac22d69bcd83fff2 Aug 05 20:37:46.846358 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: X-User-Name: admin Aug 05 20:37:46.846358 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: method: > Aug 05 20:37:46.846358 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: exception: Flavor 451 could not be found. Aug 05 20:37:46.846358 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: action_args: {'id': '451'} Aug 05 20:37:46.846358 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:37:46.846358 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:37:46.847162 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: ERROR nova.api.openstack.wsgi Aug 05 20:37:46.848225 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-2fd7b755-47a3-45f7-89a7-112c4bee411d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:37:46.849296 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-2fd7b755-47a3-45f7-89a7-112c4bee411d admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.443601 Aug 05 20:37:46.849296 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 24/49] 10.222.0.100 () {60 vars in 1198 bytes} [Fri Aug 5 20:37:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:46.859108 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-a64e834f-7e06-42f2-a885-809c9ffef9d6 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:46.877782 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-a64e834f-7e06-42f2-a885-809c9ffef9d6 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.024228 Aug 05 20:37:46.878314 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 26/50] 10.222.0.100 () {60 vars in 1215 bytes} [Fri Aug 5 20:37:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:37:46.893246 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-0647bc68-2a1b-4233-aa59-014541efb1c6 admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:46.911067 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-0647bc68-2a1b-4233-aa59-014541efb1c6 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.023619 Aug 05 20:37:46.911693 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 25/51] 10.222.0.100 () {60 vars in 1215 bytes} [Fri Aug 5 20:37:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:37:46.921381 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-5b716e0b-c89c-42c1-b883-7c0f5a8b6a3e admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:46.927222 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.wsgi [None req-5b716e0b-c89c-42c1-b883-7c0f5a8b6a3e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-5b716e0b-c89c-42c1-b883-7c0f5a8b6a3e admin admin] Request method failure captured: Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Accept: application/json Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Accept-Encoding: gzip, deflate Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Connection: keep-alive Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Content-Length: 0 Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Host: 10.222.0.100 Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Openstack-Api-Version: compute 2.90 Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Openstack-System-Scope: None Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: User-Agent: python-novaclient Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Auth-Token: gAAAAABi7X-aGleljkv2irz0p2aefzZa7RWucrlHZSFoH-SrSZY-kr97cOce6E8hRLKKTYbEwQhDQCfsHPwxGc-d6h9YYmpO8nxVN0V07q-pRiJbf54H3MTBI8My7X8yIMDxhtP1-sZkLiWdr0pmZb3T9-WMgQgzK46WtnncMIJZ-Vt2O_rVSgk Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Domain-Id: None Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Domain-Name: None Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Identity-Status: Confirmed Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Is-Admin-Project: True Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Project-Domain-Id: default Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Project-Domain-Name: Default Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Project-Id: abb569dd63634bd9bd1193603cb21bb9 Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Project-Name: admin Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Role: member,admin,reader Aug 05 20:37:46.928760 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Roles: member,admin,reader Aug 05 20:37:46.930342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/abb569dd63634bd9bd1193603cb21bb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_abb569dd63634bd9bd1193603cb21bb9", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:37:46.930342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Tenant: admin Aug 05 20:37:46.930342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Tenant-Id: abb569dd63634bd9bd1193603cb21bb9 Aug 05 20:37:46.930342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-Tenant-Name: admin Aug 05 20:37:46.930342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User: admin Aug 05 20:37:46.930342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User-Domain-Id: default Aug 05 20:37:46.930342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User-Domain-Name: Default Aug 05 20:37:46.930342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User-Id: 08fbb9e763104d83ac22d69bcd83fff2 Aug 05 20:37:46.930342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: X-User-Name: admin Aug 05 20:37:46.930342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: method: > Aug 05 20:37:46.930342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: exception: Flavor 451 could not be found. Aug 05 20:37:46.930342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: action_args: {'id': '451'} Aug 05 20:37:46.930342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:37:46.930342 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:37:46.931302 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: ERROR nova.api.openstack.wsgi Aug 05 20:37:46.932686 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-5b716e0b-c89c-42c1-b883-7c0f5a8b6a3e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:37:46.933907 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-5b716e0b-c89c-42c1-b883-7c0f5a8b6a3e admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012270 Aug 05 20:37:46.933907 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 27/52] 10.222.0.100 () {60 vars in 1198 bytes} [Fri Aug 5 20:37:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 20:37:47.923596 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-0647bc68-2a1b-4233-aa59-014541efb1c6 admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:47.924643 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-0647bc68-2a1b-4233-aa59-014541efb1c6 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001490 Aug 05 20:37:47.925042 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 26/53] 10.222.0.100 () {56 vars in 1079 bytes} [Fri Aug 5 20:37:47 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:48.513813 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-4c066f85-1e8d-44ea-8df3-c6a1b81e1a43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:48.539044 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-4c066f85-1e8d-44ea-8df3-c6a1b81e1a43 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.476646 Aug 05 20:37:48.539770 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 28/54] 10.222.0.100 () {64 vars in 1240 bytes} [Fri Aug 5 20:37:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:37:49.527910 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-0647bc68-2a1b-4233-aa59-014541efb1c6 admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:49.528913 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-0647bc68-2a1b-4233-aa59-014541efb1c6 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001517 Aug 05 20:37:49.529308 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 27/55] 10.222.0.100 () {56 vars in 1079 bytes} [Fri Aug 5 20:37:49 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:50.250799 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-94c8450c-3657-4369-9d27-f95512adaaca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:50.271429 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-94c8450c-3657-4369-9d27-f95512adaaca admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.601744 Aug 05 20:37:50.271994 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 29/56] 10.222.0.100 () {64 vars in 1240 bytes} [Fri Aug 5 20:37:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:37:51.267611 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-0647bc68-2a1b-4233-aa59-014541efb1c6 admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:51.268621 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-0647bc68-2a1b-4233-aa59-014541efb1c6 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001484 Aug 05 20:37:51.269020 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 28/57] 10.222.0.100 () {56 vars in 1079 bytes} [Fri Aug 5 20:37:51 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:51.855892 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-98cf769e-0454-4e73-a716-1c2a3d56dac4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:51.877360 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-98cf769e-0454-4e73-a716-1c2a3d56dac4 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.471097 Aug 05 20:37:51.877905 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 30/58] 10.222.0.100 () {64 vars in 1240 bytes} [Fri Aug 5 20:37:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:37:52.856745 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-0647bc68-2a1b-4233-aa59-014541efb1c6 admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:52.857751 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-0647bc68-2a1b-4233-aa59-014541efb1c6 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001437 Aug 05 20:37:52.858142 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 29/59] 10.222.0.100 () {56 vars in 1079 bytes} [Fri Aug 5 20:37:52 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:53.415025 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-659990ff-34cb-4c47-8674-554def755aaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:37:53.436359 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-659990ff-34cb-4c47-8674-554def755aaa admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.441793 Aug 05 20:37:53.436910 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 31/60] 10.222.0.100 () {64 vars in 1240 bytes} [Fri Aug 5 20:37:52 2022] POST /compute/v2.1/flavors => generated 411 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:37:54.452874 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-0647bc68-2a1b-4233-aa59-014541efb1c6 admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:54.453922 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-0647bc68-2a1b-4233-aa59-014541efb1c6 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001487 Aug 05 20:37:54.454323 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 30/61] 10.222.0.100 () {56 vars in 1079 bytes} [Fri Aug 5 20:37:54 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:37:55.013890 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-cb7d3ed7-2a09-4ef0-bfaa-6b3d0f412a09 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:37:55.034748 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-cb7d3ed7-2a09-4ef0-bfaa-6b3d0f412a09 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.442955 Aug 05 20:37:55.035208 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 32/62] 10.222.0.100 () {60 vars in 1207 bytes} [Fri Aug 5 20:37:54 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:38:46.950877 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-0647bc68-2a1b-4233-aa59-014541efb1c6 admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:38:46.951901 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-0647bc68-2a1b-4233-aa59-014541efb1c6 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001472 Aug 05 20:38:46.952309 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 31/63] 10.222.0.100 () {54 vars in 936 bytes} [Fri Aug 5 20:38:46 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:38:46.965619 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG dbcounter [-] [109918] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:47.381754 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-37e1f527-b493-4c8b-b951-3d819d731b76 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:38:47.402435 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-37e1f527-b493-4c8b-b951-3d819d731b76 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.443589 Aug 05 20:38:47.402993 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 33/64] 10.222.0.100 () {60 vars in 1297 bytes} [Fri Aug 5 20:38:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:38:47.429109 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG dbcounter [-] [109919] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=109919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:38:47.433111 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-d9f63ef6-45dc-43a0-a61a-5d8460f562f9 admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:38:47.441250 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-d9f63ef6-45dc-43a0-a61a-5d8460f562f9 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013615 Aug 05 20:38:47.441756 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 32/65] 10.222.0.100 () {60 vars in 1288 bytes} [Fri Aug 5 20:38:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:38:47.454156 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-39e1fc29-6140-4838-a806-ceed80c49219 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:38:47.462209 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-39e1fc29-6140-4838-a806-ceed80c49219 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011690 Aug 05 20:38:47.463238 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 34/66] 10.222.0.100 () {60 vars in 1291 bytes} [Fri Aug 5 20:38:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:38:47.477738 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-87fe30f5-75ff-464e-9e6f-b845150edf8a admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:38:47.486278 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-87fe30f5-75ff-464e-9e6f-b845150edf8a admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014819 Aug 05 20:38:47.486807 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 33/67] 10.222.0.100 () {60 vars in 1291 bytes} [Fri Aug 5 20:38:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:38:47.505021 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-e9b3699b-8439-4d26-954a-1f48c31ca2d1 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:38:47.514783 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-e9b3699b-8439-4d26-954a-1f48c31ca2d1 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015474 Aug 05 20:38:47.515235 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 35/68] 10.222.0.100 () {60 vars in 1288 bytes} [Fri Aug 5 20:38:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:41:55.864420 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-87fe30f5-75ff-464e-9e6f-b845150edf8a admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:41:55.865535 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-87fe30f5-75ff-464e-9e6f-b845150edf8a admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001578 Aug 05 20:41:55.865953 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 34/69] 10.222.0.100 () {56 vars in 1079 bytes} [Fri Aug 5 20:41:55 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:41:56.010066 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG dbcounter [-] [109918] Writing DB stats nova_api:SELECT=6 {{(pid=109918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:41:56.187607 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-10333833-edc4-4d7f-bac2-4e9391b460a0 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:41:56.190077 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:41:56.190077 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: warnings.warn(msg) Aug 05 20:41:56.191517 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-10333833-edc4-4d7f-bac2-4e9391b460a0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:41:56.192202 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-10333833-edc4-4d7f-bac2-4e9391b460a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:41:56.192878 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-10333833-edc4-4d7f-bac2-4e9391b460a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:41:56.193633 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-10333833-edc4-4d7f-bac2-4e9391b460a0 admin admin] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:41:56.194081 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-10333833-edc4-4d7f-bac2-4e9391b460a0 admin admin] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:41:56.194501 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-10333833-edc4-4d7f-bac2-4e9391b460a0 admin admin] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:41:56.229724 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-10333833-edc4-4d7f-bac2-4e9391b460a0 admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.221665 Aug 05 20:41:56.230373 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 36/70] 10.222.0.100 () {60 vars in 1198 bytes} [Fri Aug 5 20:41:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:41:57.072380 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-87fe30f5-75ff-464e-9e6f-b845150edf8a admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:41:57.073394 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-87fe30f5-75ff-464e-9e6f-b845150edf8a admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001450 Aug 05 20:41:57.073796 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 35/71] 10.222.0.100 () {56 vars in 1079 bytes} [Fri Aug 5 20:41:57 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:41:57.290451 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-b8142fed-7972-4f24-93ce-322d547a07d4 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:41:57.292906 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:41:57.292906 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: warnings.warn(msg) Aug 05 20:41:57.294047 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-b8142fed-7972-4f24-93ce-322d547a07d4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:41:57.294556 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-b8142fed-7972-4f24-93ce-322d547a07d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:41:57.295012 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-b8142fed-7972-4f24-93ce-322d547a07d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:41:57.295767 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-b8142fed-7972-4f24-93ce-322d547a07d4 admin admin] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:41:57.296221 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-b8142fed-7972-4f24-93ce-322d547a07d4 admin admin] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:41:57.296632 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-b8142fed-7972-4f24-93ce-322d547a07d4 admin admin] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:41:57.316353 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-b8142fed-7972-4f24-93ce-322d547a07d4 admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.099931 Aug 05 20:41:57.316921 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 37/72] 10.222.0.100 () {60 vars in 1198 bytes} [Fri Aug 5 20:41:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:42:08.567503 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-87fe30f5-75ff-464e-9e6f-b845150edf8a admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:42:08.568577 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-87fe30f5-75ff-464e-9e6f-b845150edf8a admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001490 Aug 05 20:42:08.568984 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 36/73] 10.222.0.100 () {56 vars in 1079 bytes} [Fri Aug 5 20:42:08 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:42:08.713248 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG dbcounter [-] [109918] Writing DB stats nova_cell0:SELECT=4 {{(pid=109918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:42:08.713975 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG dbcounter [-] [109918] Writing DB stats nova_cell1:SELECT=4 {{(pid=109918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:42:08.714601 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG dbcounter [-] [109918] Writing DB stats nova_api:SELECT=8 {{(pid=109918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:42:08.765831 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-59bf8dab-2e09-4720-9606-21c8a6e9cfe1 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:42:08.768233 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:42:08.768233 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: warnings.warn(msg) Aug 05 20:42:08.769340 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-59bf8dab-2e09-4720-9606-21c8a6e9cfe1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:42:08.769817 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-59bf8dab-2e09-4720-9606-21c8a6e9cfe1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:42:08.770248 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-59bf8dab-2e09-4720-9606-21c8a6e9cfe1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:42:08.771016 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-59bf8dab-2e09-4720-9606-21c8a6e9cfe1 admin admin] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:42:08.771442 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-59bf8dab-2e09-4720-9606-21c8a6e9cfe1 admin admin] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:42:08.772250 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-59bf8dab-2e09-4720-9606-21c8a6e9cfe1 admin admin] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:42:08.796984 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-59bf8dab-2e09-4720-9606-21c8a6e9cfe1 admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089691 Aug 05 20:42:08.797536 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 38/74] 10.222.0.100 () {60 vars in 1198 bytes} [Fri Aug 5 20:42:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:42:09.650757 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: DEBUG nova.api.openstack.wsgi [None req-87fe30f5-75ff-464e-9e6f-b845150edf8a admin admin] Calling method '>' {{(pid=109919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:42:09.652047 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: INFO nova.api.openstack.requestlog [None req-87fe30f5-75ff-464e-9e6f-b845150edf8a admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001938 Aug 05 20:42:09.652668 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: [pid: 109919|app: 0|req: 37/75] 10.222.0.100 () {56 vars in 1079 bytes} [Fri Aug 5 20:42:09 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:42:09.861591 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG nova.api.openstack.wsgi [None req-a1abd6f4-b08f-4161-b24b-1fe15f315597 admin admin] Calling method '>' {{(pid=109918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:42:09.865350 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 20:42:09.865350 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: warnings.warn(msg) Aug 05 20:42:09.866790 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-a1abd6f4-b08f-4161-b24b-1fe15f315597 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:42:09.867515 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-a1abd6f4-b08f-4161-b24b-1fe15f315597 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:42:09.868090 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-a1abd6f4-b08f-4161-b24b-1fe15f315597 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:42:09.869202 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-a1abd6f4-b08f-4161-b24b-1fe15f315597 admin admin] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:42:09.869832 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-a1abd6f4-b08f-4161-b24b-1fe15f315597 admin admin] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:42:09.870429 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: DEBUG oslo_concurrency.lockutils [None req-a1abd6f4-b08f-4161-b24b-1fe15f315597 admin admin] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:42:09.896259 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: INFO nova.api.openstack.requestlog [None req-a1abd6f4-b08f-4161-b24b-1fe15f315597 admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.105064 Aug 05 20:42:09.896946 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: [pid: 109918|app: 0|req: 39/76] 10.222.0.100 () {60 vars in 1198 bytes} [Fri Aug 5 20:42:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:43:07.911669 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: Fri Aug 5 20:43:07 2022 - graceful shutdown triggered... Aug 05 20:43:07.911426 dv-cinder-852208-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 05 20:43:07.912670 dv-cinder-852208-3-iscsi devstack@n-api.service[109919]: Gracefully killing worker 2 (pid: 109919)... Aug 05 20:43:07.913043 dv-cinder-852208-3-iscsi devstack@n-api.service[109918]: Gracefully killing worker 1 (pid: 109918)... Aug 05 20:43:08.912474 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: worker 1 buried after 1 seconds Aug 05 20:43:08.912474 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: worker 2 buried after 1 seconds Aug 05 20:43:08.912474 dv-cinder-852208-3-iscsi devstack@n-api.service[109917]: goodbye to uWSGI. Aug 05 20:43:08.915088 dv-cinder-852208-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 05 20:43:08.917006 dv-cinder-852208-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 05 20:43:08.921547 dv-cinder-852208-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 20:43:08.937136 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 20:43:08.939859 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 20:43:08 2022] *** Aug 05 20:43:08.940027 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 20:43:08.940160 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 20:43:08.940279 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: nodename: dv-cinder-852208-3-iscsi Aug 05 20:43:08.940387 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: machine: x86_64 Aug 05 20:43:08.940495 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: clock source: unix Aug 05 20:43:08.940607 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: pcre jit disabled Aug 05 20:43:08.940714 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: detected number of CPU cores: 4 Aug 05 20:43:08.940843 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: current working directory: / Aug 05 20:43:08.940843 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: detected binary path: /usr/bin/uwsgi-core Aug 05 20:43:08.940843 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: your processes number limit is 47680 Aug 05 20:43:08.940843 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: your memory page size is 4096 bytes Aug 05 20:43:08.940843 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: detected max file descriptor number: 2048 Aug 05 20:43:08.940843 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: lock engine: pthread robust mutexes Aug 05 20:43:08.941338 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: thunder lock: enabled Aug 05 20:43:08.941338 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 20:43:08.941338 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 20:43:08.983672 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: Python main interpreter initialized at 0x55bde42ce9c0 Aug 05 20:43:08.985250 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: python threads support enabled Aug 05 20:43:08.985426 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: your server socket listen backlog is limited to 100 connections Aug 05 20:43:08.985565 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: your mercy for graceful operations on workers is 90 seconds Aug 05 20:43:08.986015 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 20:43:08.986257 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: *** Operational MODE: preforking *** Aug 05 20:43:08.986724 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: *** uWSGI is running in multiple interpreter mode *** Aug 05 20:43:08.986894 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: spawned uWSGI master process (pid: 124410) Aug 05 20:43:08.987251 dv-cinder-852208-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 20:43:08.992550 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: spawned uWSGI worker 1 (pid: 124431, cores: 1) Aug 05 20:43:08.992550 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: spawned uWSGI worker 2 (pid: 124432, cores: 1) Aug 05 20:43:08.992550 dv-cinder-852208-3-iscsi devstack@n-api.service[124410]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 20:43:09.643449 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 20:43:09.653703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 20:43:10.786971 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:43:10.786971 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: from cryptography.utils import int_from_bytes Aug 05 20:43:10.787696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:43:10.787696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: from cryptography.utils import int_from_bytes Aug 05 20:43:10.806464 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:43:10.806464 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: from cryptography.utils import int_from_bytes Aug 05 20:43:10.807077 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 20:43:10.807077 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: from cryptography.utils import int_from_bytes Aug 05 20:43:13.108898 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 20:43:13.109384 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 20:43:13.109682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 20:43:13.110042 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 20:43:13.110264 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 20:43:13.110676 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.110997 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.111314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.111664 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.111991 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.112295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.112581 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.112927 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.113252 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.113511 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.113800 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.114103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-3-iscsi {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.114517 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.114729 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.115035 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.115390 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.115685 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.115991 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.116332 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.116783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.117954 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.117954 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.117954 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.118189 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.118498 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.118804 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.119118 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.119448 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.119770 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.120075 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.120474 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-3-iscsi {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.120774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.121081 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.121390 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.121799 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.122113 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.122437 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.122760 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.123074 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.123391 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.123729 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.124039 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.124359 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.124671 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.124960 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.125262 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.125561 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.125883 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.126177 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.126477 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.126723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.127026 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.127343 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.127674 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.127991 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.128240 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.128487 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.128799 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.129112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.129415 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.129716 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.130015 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.130314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.130613 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.130913 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.131214 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.131541 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.131853 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.132162 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.132478 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.132779 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.133090 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.133565 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.133825 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.134125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.134457 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.134778 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.135081 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.135404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.135720 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.136028 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.136327 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.136629 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.136940 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.137284 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.137586 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.137805 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.138102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.138422 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.138730 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.139027 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.139327 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.139649 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.139925 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.140223 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.140521 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.140818 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.141127 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.141414 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.141714 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.142005 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.142306 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.142603 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.143404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.143404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.143602 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.143805 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.144106 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.144408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.144720 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.145027 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.145321 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.145636 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.145942 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.146239 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.146366 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 20:43:13.146783 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 20:43:13.146858 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.146858 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.147004 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 20:43:13.147197 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.147402 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 20:43:13.147520 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.147668 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 20:43:13.147768 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.148030 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.148143 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.148346 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.148460 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.148712 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.148858 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.149008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.149192 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.149344 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.149606 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.149769 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.149923 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.150072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.150223 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.150372 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.150527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.150685 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.150784 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.150919 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.151008 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.151107 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.151188 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.151316 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.151591 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-3-iscsi {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.151685 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.151987 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.152142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.152242 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.152370 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.152515 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.152606 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.152824 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.152923 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.153125 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.153265 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.153474 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.153743 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.153922 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.154053 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.154147 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.154418 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.154559 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.154740 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.154896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.155046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.155148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.155337 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.155521 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.155683 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.155816 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.155954 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.156129 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.156243 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.156440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.156561 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.156757 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.156861 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.157064 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.157164 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.157386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.157807 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.158019 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.158157 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.158382 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.158537 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-3-iscsi {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.158695 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.158788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.159010 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.159115 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.159346 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.159522 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.159652 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.159745 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.159979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.160077 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.160356 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.160462 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.160663 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.160775 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.160999 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.161103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.161304 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.161408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.161623 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.161713 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.161940 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.162029 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.162253 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.162353 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.162560 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.162660 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.162857 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.162955 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.163164 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.163258 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.163497 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.163594 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.163814 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.163916 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.164117 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.164221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.164417 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.164517 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.164666 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.164906 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.165038 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.165127 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.165357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.165469 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.165661 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.165766 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.165966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.166066 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.166206 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.166305 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.166451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.166588 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.166769 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.166899 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.167085 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.167211 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.167419 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.167548 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.167727 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.167855 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.168032 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.168159 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.168335 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.168463 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.168639 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.168761 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.168941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.169064 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.169245 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.169360 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.169549 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.169653 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.169864 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.169957 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.170176 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.170276 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.170492 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.170592 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.170798 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.170899 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.171118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.171232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.171454 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.171567 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.171760 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.171871 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.172063 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.172155 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.172364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.172454 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.172725 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.172842 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.172967 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.173068 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.173271 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.173363 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.173571 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.173673 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.173887 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.173979 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.174190 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.174290 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.174490 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.174589 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.174807 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.174900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.175106 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.175199 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.175427 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.175538 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.175713 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.175813 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.176013 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.176153 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.176430 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.176532 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.176664 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.176750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.176928 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.177053 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.177197 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.177337 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.177501 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.177638 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.177800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.177930 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.178103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.178232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.178542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.178692 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.178806 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.178915 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.179030 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.179154 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.179287 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.179474 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.179599 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.179812 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.179953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.180074 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.180191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.180307 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.180511 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.180630 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.180828 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.180954 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.182191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.182358 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.182467 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.182562 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.182716 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.182816 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.182904 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.182987 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.183085 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.183171 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.183261 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.183345 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.184344 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.184505 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.184621 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.184740 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.184865 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.184970 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.185066 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.185159 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.185255 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.185399 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.185494 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.185585 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.185692 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.185779 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.185862 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.185953 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.186037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.186127 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.186266 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.186384 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.186499 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.186598 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.186685 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.186804 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.186911 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.186997 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.187079 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.187170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.187267 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.187443 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.187536 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.187636 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.187728 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.187936 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.188037 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.188238 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.188340 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.188555 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.188647 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.188861 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.188953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.189173 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.189267 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.189478 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.189582 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.189783 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.189874 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.190085 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.190183 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.190389 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.190546 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.190685 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.190776 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 20:43:13.190995 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.191102 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.191327 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.191505 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.191674 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.191784 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.191983 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.192085 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.192302 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.192442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.192702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.192828 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.192925 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.193019 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.193207 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.193302 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.193581 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.193704 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.193831 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.193932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.194106 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.194224 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.194427 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.194592 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.194735 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.194878 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.195081 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.195246 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.195438 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.195541 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.195660 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.195762 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.195987 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.196097 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.196329 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.196430 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.196649 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.196744 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.196962 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.197055 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.197280 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.197374 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.197611 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.197701 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.197932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.198023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.198236 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.198328 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.198551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.198650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.198856 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.198961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.199156 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.199255 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.199484 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.199580 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.199785 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.199896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.200085 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.200177 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.200388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.200481 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.200695 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.200796 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.201000 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.201092 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.201304 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.201402 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.201600 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.201706 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.201908 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.202011 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.202209 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.202308 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.202508 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.202674 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.202794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.203089 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.203206 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.203418 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.203724 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.203817 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.204064 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.204342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.204453 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.204637 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.204932 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.205024 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.205264 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.205520 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.205619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.205832 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.206126 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.206236 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.206419 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.206714 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.206806 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.207044 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.207323 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.207505 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.207669 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.207959 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.208050 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.208278 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.208539 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.208639 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.208879 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.209123 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.209223 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.209485 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.209715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.209807 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.210086 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.210298 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.210443 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.210684 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.210868 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.210991 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.211296 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.211521 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.211784 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.212064 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.212216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.212368 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.212723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.212923 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.213084 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.213258 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.213407 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.213572 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.213883 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.214160 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.214495 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.214645 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.214811 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.215091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.215247 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.215480 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.215715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.215873 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.216077 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.216303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.216451 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.216745 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.216902 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.217059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.217343 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.217511 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.217654 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.217934 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.218081 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.218244 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.218548 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.218711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.218900 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.219170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.219388 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.219516 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.219742 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.219843 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.220069 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.220334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.220500 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.220663 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.220835 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.221003 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.221113 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.221207 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.221471 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.221572 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.221781 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.221872 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.222101 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.222195 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.222406 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.222498 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.222707 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.222823 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.223009 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.223139 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.223308 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.223492 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.223668 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.223772 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.224254 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.224368 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.224456 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.224552 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.224639 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.224730 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.224926 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.225027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.225227 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.225337 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.225529 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.225763 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.225923 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.226078 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.226227 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.226382 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.226523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.226663 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.226820 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.226957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.227056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.227152 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.227390 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.227502 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.227696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.227817 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.228080 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.228241 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.228413 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.228515 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.228677 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.228842 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.228984 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.229113 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.229304 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.229472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.229651 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.229807 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.229962 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.230151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.230255 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.230351 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.230461 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.230559 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.230733 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.230833 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.230985 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.231080 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.231295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.231513 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.231668 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.231819 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.231914 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.232017 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.232230 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.232385 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.232521 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.232622 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.232832 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.232933 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.233138 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.233276 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.233438 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.233554 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.233736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.233829 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.234043 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.234152 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.234348 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.234449 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.234645 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.234738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.234961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.235063 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.235264 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.235408 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.235586 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.235719 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.235885 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.236033 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.236191 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.236357 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.236491 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.236669 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.237523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.237631 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.237706 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.237790 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.237955 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.238061 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.238194 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.238284 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.238376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.238469 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.238553 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.238652 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.238768 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.238886 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.239004 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.239188 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.239308 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.239575 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.239715 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.239872 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.240020 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.240170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.240271 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.240469 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.240572 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.240769 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.240862 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.241067 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.241175 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.241383 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.241475 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.241689 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.241789 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.241990 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.242099 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.242290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.242384 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.242587 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.242679 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.242928 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.243036 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.243243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.243467 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.243623 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.243964 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.244110 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.244300 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.244452 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.244601 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.244739 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.244917 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.245070 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.245208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.245349 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.245493 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.245591 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.245767 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.245870 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.246067 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.246168 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.246377 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.246477 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.246682 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.246789 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.246990 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.247088 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.247295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.247413 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.247638 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.247742 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.247955 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.248047 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.248262 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.248362 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.248568 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.248670 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.248881 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.248988 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.249185 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.249362 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.249518 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.249669 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.249781 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.249869 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.250075 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.250166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.250381 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.250475 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.250687 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.250822 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.250991 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.251110 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.251299 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.251528 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.251619 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.251711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.251903 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.252003 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.252210 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.252302 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.252510 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.252610 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.252809 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.252910 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.253111 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.253203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.253421 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.253557 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.253725 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.253851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.254020 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.254131 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.254337 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.254459 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.254639 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.254876 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.254981 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.255067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.255225 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.255351 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.255567 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.255715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.255859 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.255988 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.256180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.256494 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.256805 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.256971 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.257126 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.257362 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.257529 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.257683 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.257841 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.257985 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.258135 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.258285 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.258437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.258661 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.258892 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.259046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.259200 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.259343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.259544 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.259699 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.259852 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.260040 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.260454 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.260761 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.260989 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.261101 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.261329 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.261429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.261649 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.261933 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.262024 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.262241 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.262344 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.262560 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.262678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.262858 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.262971 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.263158 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.263260 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.264322 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.264491 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.264621 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.264746 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.264746 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.264965 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.265061 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.265147 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.265147 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.265421 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.265520 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.265606 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.265690 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.265781 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.265867 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.265957 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.266043 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.266175 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.266373 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.266476 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.266693 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.266830 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.267002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.267098 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.267314 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.267453 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.267646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.267739 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.267953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.268053 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.268260 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.268361 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.268566 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.268666 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.268882 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.268982 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.269190 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.269291 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.269498 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.269590 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.269842 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.269981 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.270104 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.270200 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.270408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.270545 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.270709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.270812 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.271015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.271116 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.271319 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.271435 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.271688 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.271796 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.271994 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.272087 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.272334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.272435 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.272652 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.272754 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.272954 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.273055 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.273253 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.273346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.273557 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.273651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.273856 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.273951 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.274243 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.274338 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.274585 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.274685 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.274896 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.274987 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.275203 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.275303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.275532 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.275635 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.275838 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.275939 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.276136 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.276230 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.276434 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.276527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.276748 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.276841 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.277048 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.277142 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.277369 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.277469 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.277674 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.277774 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.277987 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.278093 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.278301 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.278400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.278676 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.278780 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.278897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.279000 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.279200 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.279293 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.279557 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.279651 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.279874 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.280041 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.280158 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.280236 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.280475 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.280580 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.280803 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.280966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.281118 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.281261 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.281406 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.281546 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.281694 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.281842 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.281981 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.282082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.282305 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.282449 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.282937 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.283081 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.283223 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.283390 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.283565 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.283669 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.283868 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.283968 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.284168 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.284265 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.284465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.284572 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.284771 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.284862 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.285065 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.285156 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.285363 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.285469 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.285658 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.285752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.285962 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.286062 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.286261 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.286374 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.286556 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.286650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.286853 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.286958 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.287151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.287328 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.287475 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.287598 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.287769 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.287903 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.288074 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.288192 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.288372 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.288491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.288670 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.288970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.289274 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.289428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.289574 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.289823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.290107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.290287 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.290541 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.290662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.290773 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.290883 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.290992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.291117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.291239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.291839 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.292046 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.292154 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.292254 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.292402 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.292501 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.292587 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.292680 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.292764 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.292859 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.292944 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.293111 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.293205 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.293420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.293522 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.293729 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.293824 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.294042 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.294135 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.294345 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.294453 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.294662 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.294766 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.294972 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.295220 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.295314 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.295601 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.295738 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.295904 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.296031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.296224 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.296343 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.296536 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.296663 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.296847 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.296975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.297161 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.297286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.297475 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.297596 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.297785 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.297913 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.298086 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.298214 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.298392 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.298516 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.298697 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.298814 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.299005 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.299137 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.299312 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.299512 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.299640 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.299762 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.299944 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.300120 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.300388 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.300536 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.300727 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.300852 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.300979 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.301091 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.301225 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.301335 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.301447 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.301574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.302106 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.302220 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.302329 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.302438 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.302566 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.302676 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.302795 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.302906 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.303015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.303144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.303254 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.303420 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.303550 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.303680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.303799 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.303916 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.304180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.304336 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.304512 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.304628 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.304818 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.304953 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.305125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.305291 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.305491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.305662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.305849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.306008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.306240 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.306361 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.306471 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.306580 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.306698 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.306816 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.306937 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.307093 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.307222 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.307665 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.307790 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.307976 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.308110 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.308286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.308413 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.308595 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.308715 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.308899 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.309106 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.309222 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.309476 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.309595 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.309804 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.309931 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.310106 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.310241 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.310552 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.310670 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.310891 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.311027 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.311141 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.311259 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.311407 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.311545 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.311657 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.312209 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.312329 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.312450 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.312570 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.312679 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.312789 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.313004 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.313123 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.313318 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.313438 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.313628 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.313854 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.313982 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.314335 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.314569 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.314712 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.314872 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.315002 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.315186 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.315305 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.315526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.315729 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.315855 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.315987 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.316174 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.316311 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.316431 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.316550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.316752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.316914 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.317051 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.317171 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.317373 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.317492 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.317685 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.317811 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.317993 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.318135 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.318283 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.318401 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.318582 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.318701 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.318888 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.319006 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.319194 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.319321 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.319517 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.319647 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.319825 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.319952 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.320126 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.320245 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.320610 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.320758 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.320889 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.321155 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.321289 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.321417 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.321536 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.321647 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.321823 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.322469 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.322602 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.322730 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.322843 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.322961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.323081 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.323200 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.323319 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.323521 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.323638 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.323756 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.323868 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.323988 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.324101 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.324221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.324340 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.324563 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.324690 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.324807 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.324929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.325048 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.325161 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.325334 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.325454 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.325635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.325769 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.325956 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.326084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.326259 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.326379 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.326589 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.326724 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.326884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.327021 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.327783 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.327907 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.327907 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.328125 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.328245 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.328366 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.328476 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.328586 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.328586 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.328809 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.328809 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.329041 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.329041 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.329301 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.329432 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.329628 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.329755 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.329946 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.330073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.330279 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.330412 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.330731 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.330897 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.330897 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.331291 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.331447 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.331574 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.331737 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.331861 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.331861 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.332084 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.332540 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.332691 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.332901 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.333025 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.333136 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.333246 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.333370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.333488 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.333632 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.333756 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.333875 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.333994 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.334119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.334231 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.334347 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.334458 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.334458 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.334809 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.334926 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.335035 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.335145 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.335255 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.335255 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.335507 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.335629 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.335741 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.335909 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.336023 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.336194 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.336328 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.336516 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.336921 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.337081 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.337192 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.337317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.337443 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.337561 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.337678 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.337857 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.337978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.338245 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.338455 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.338592 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.338705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.338816 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.339002 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.339132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.339313 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.339475 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.339656 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.339759 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.339987 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.340080 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.340300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.340380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.340600 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.340703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.341030 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.341158 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.341365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.341494 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.341637 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.341789 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.341957 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.342102 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.342397 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.342702 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.342820 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.343049 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.343181 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.343303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.343446 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.343561 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.343671 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.343794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.343915 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.344027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.344197 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.344330 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.344536 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.344727 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.345114 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.345304 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.345486 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.345677 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.345875 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.346074 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.346271 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.346460 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.346642 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.346826 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.347006 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.347247 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.347520 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.347755 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.347976 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.348224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.348224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.348655 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.348844 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.349036 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.349235 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.349430 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.349627 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.349810 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.349993 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.350196 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.350382 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.350588 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.350780 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.351289 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.351686 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.353690 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.353900 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.354101 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.354272 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.354451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.354630 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.354813 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.355005 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.355459 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.355600 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.355731 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.355844 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.355962 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.356072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.356196 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.356308 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.356425 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.356544 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.356657 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.356777 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.356895 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.357006 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.357124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.357244 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.357244 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.357461 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.357572 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.357682 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.357791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.357900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.358009 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.358133 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.358258 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.358375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.358485 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.358613 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.358725 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.358845 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.358845 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.359050 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.359168 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.359277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.359419 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.359542 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.359653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.359769 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.359880 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.359989 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.360112 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.360231 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.360342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.360452 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.360561 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.360678 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.360801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.360912 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.361028 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.361157 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.361466 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.361616 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.361616 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.361934 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.362046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.362156 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.362264 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.362384 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.362496 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.362632 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.362914 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.363183 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.363310 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.363461 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.363600 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.363847 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.363967 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.364087 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.364198 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.364318 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.365033 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.365171 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.365290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.365514 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.365644 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.365757 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.365757 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.365962 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.366082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.366193 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.366322 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.366441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.366561 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.366671 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.366788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.366898 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.367026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.367139 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.367250 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.367401 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.367532 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.367654 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.367765 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.367912 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.368038 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.368150 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.368268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.368392 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.368559 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.368728 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.368855 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.368966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.369075 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.369267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.369388 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.369388 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.369602 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.369724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.369842 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.369962 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.370072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.370192 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.370302 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.370412 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.370535 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.370655 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.370764 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 20:43:13.370899 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.370899 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.370899 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.370899 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.370899 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.370899 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.370899 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.372017 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.372017 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.372017 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.372333 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.372496 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.373005 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.373410 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.373746 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.374068 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.374412 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.374792 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.375198 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.375626 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.375921 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.376251 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.376567 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.376879 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.377189 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.377500 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.377809 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.378119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.378432 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.378846 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.379049 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.379382 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.379693 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.380069 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.380306 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.380716 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.381040 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.381398 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.381802 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.382100 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.382349 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.382667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.383170 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.383680 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.383884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.384242 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.385117 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.385117 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.385368 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.385601 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.386046 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.386358 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.386704 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.387008 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.387568 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.387778 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.388106 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.388420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.388747 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.389061 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.389391 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.389733 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.390064 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.390389 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.390696 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.391002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.391305 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.392285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.392285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.392597 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.392775 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.393028 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.393441 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.393817 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.393967 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.394214 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.394519 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.394811 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.395175 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.395492 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.396030 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.396362 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.396762 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.397208 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.397527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.397955 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.398220 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.398596 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.398836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.399204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.399680 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.400022 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.400343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.400668 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.400984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.401319 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.401767 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.402453 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.402686 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.403026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.403517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.403710 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.404074 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.404304 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.404645 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.404921 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.405277 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.405544 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.405881 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.406280 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.406509 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.406974 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.407770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.408115 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.408428 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.408739 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.409071 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.409386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.411650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.411650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.411650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.411650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.411650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.411650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.411650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.413442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.413442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.413442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.413442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.413442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.413442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.414770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.414770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.414770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.414770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.415617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.415617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.415617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.416027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 20:43:13.416180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 20:43:13.528491 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO dbcounter [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] Registered counter for database nova_api Aug 05 20:43:13.549439 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_db.sqlalchemy.engines [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:43:13.557463 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writer thread running {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:43:13.568923 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO dbcounter [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] Registered counter for database nova_api Aug 05 20:43:13.589313 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_db.sqlalchemy.engines [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:43:13.596212 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writer thread running {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:43:13.613584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.context [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa2e0ab0-e014-4390-9eb9-f79d2e1db09c(cell1) {{(pid=124431) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 20:43:13.617664 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:43:13.618201 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:43:13.619902 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:43:13.620633 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:43:13.621067 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:43:13.623046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:43:13.625101 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO dbcounter [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] Registered counter for database nova_cell0 Aug 05 20:43:13.629190 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO dbcounter [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] Registered counter for database nova_cell1 Aug 05 20:43:13.636628 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_db.sqlalchemy.engines [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:43:13.638419 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_db.sqlalchemy.engines [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:43:13.644514 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writer thread running {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:43:13.646080 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writer thread running {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:43:13.652465 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.context [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa2e0ab0-e014-4390-9eb9-f79d2e1db09c(cell1) {{(pid=124432) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 20:43:13.656554 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:43:13.657030 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:43:13.658916 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:43:13.659668 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:43:13.660119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:43:13.662106 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:43:13.664148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO dbcounter [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] Registered counter for database nova_cell0 Aug 05 20:43:13.668266 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO dbcounter [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] Registered counter for database nova_cell1 Aug 05 20:43:13.675395 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_db.sqlalchemy.engines [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:43:13.677150 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_db.sqlalchemy.engines [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:43:13.682874 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writer thread running {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:43:13.689012 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writer thread running {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:43:13.795422 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO dbcounter [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] Registered counter for database nova_cell0 Aug 05 20:43:13.802598 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_db.sqlalchemy.engines [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:43:13.807677 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writer thread running {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:43:13.842730 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO dbcounter [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] Registered counter for database nova_cell0 Aug 05 20:43:13.852298 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_db.sqlalchemy.engines [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 20:43:13.857121 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writer thread running {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 20:43:14.121086 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: WARNING keystonemiddleware.auth_token [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:43:14.128995 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: WARNING keystonemiddleware.auth_token [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:43:14.176314 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: WARNING keystonemiddleware.auth_token [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:43:14.183863 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: WARNING keystonemiddleware.auth_token [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:43:14.469613 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: WARNING keystonemiddleware.auth_token [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:43:14.475649 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: WARNING keystonemiddleware.auth_token [None req-d8fa2a39-c4ab-420b-b167-c7da3e7e465b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:43:14.482162 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bde42ce9c0 pid: 124431 (default app) Aug 05 20:43:14.526065 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: WARNING keystonemiddleware.auth_token [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 20:43:14.532208 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: WARNING keystonemiddleware.auth_token [None req-a054647d-fc46-4264-8b89-e8a3e5de5f77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 20:43:14.538746 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bde42ce9c0 pid: 124432 (default app) Aug 05 20:43:49.900248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=3 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:49.901822 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=3 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:49.902656 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=3 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:49.903415 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=3 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:51.229038 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-26532177-4c81-4ab0-9978-963d5433905c tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] Action: 'create', calling method: .version_select at 0x7f9bed817e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-611404552", "metadata": {"Type": "work"}}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:43:51.564368 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:51.565400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:51.566393 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:51.567345 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:43:53.183153 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d83e8c50-11a5-4551-8744-115afa1d017c tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Action: 'create', calling method: .version_select at 0x7f9bed76cdc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1757756185", "metadata": {"Type": "work"}}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d83e8c50-11a5-4551-8744-115afa1d017c tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Request method failure captured: Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 122 Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEH1UhAYPDz4g02MpQ1du75xnlR_NmI52j0XfH_9HVvfHAL794PJSj_OzPE-WeX61YQcHR6NRjiLGsVyq9pZwtPwnRwYoWhTkmPQ3WpwKNtzkorML1njclskEmH3uzxm7gtYeZTFzzxuf_kTE7KtS3PnoPQ2D_ZmT7nQdpDd1nMyII Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 536cdbe85a4548b4ab38deeb771c920c Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:43:53.190918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:43:53.192346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_536cdbe85a4548b4ab38deeb771c920c", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:43:53.192346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:53.192346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 536cdbe85a4548b4ab38deeb771c920c Aug 05 20:43:53.192346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:53.192346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesNegativeTest-294111963-project Aug 05 20:43:53.192346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:43:53.192346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:43:53.192346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 75ce73cad1614c5fa96b7e95b36326e0 Aug 05 20:43:53.192346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesNegativeTest-294111963-project Aug 05 20:43:53.192346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Aug 05 20:43:53.192346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1757756185", "metadata": {"Type": "work"}}} Aug 05 20:43:53.192346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: Aug 05 20:43:53.192346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1757756185', 'metadata': {'Type': 'work'}}}} Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise error Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi '#$%' Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:43:53.193166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 20:43:53.194451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 20:43:53.195738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 20:43:53.195738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.197656 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d83e8c50-11a5-4551-8744-115afa1d017c tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:43:53.199094 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d83e8c50-11a5-4551-8744-115afa1d017c tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.659345 Aug 05 20:43:53.200878 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 1/1] 10.222.0.100 () {60 vars in 1161 bytes} [Fri Aug 5 20:43:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1663 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:43:53.213699 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0adda001-7a45-4eab-a599-4669c0322774 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Action: 'create', calling method: .version_select at 0x7f9bed66e8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-891224262", "metadata": {"Type": "work"}}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0adda001-7a45-4eab-a599-4669c0322774 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Request method failure captured: Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 119 Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEH1UhAYPDz4g02MpQ1du75xnlR_NmI52j0XfH_9HVvfHAL794PJSj_OzPE-WeX61YQcHR6NRjiLGsVyq9pZwtPwnRwYoWhTkmPQ3WpwKNtzkorML1njclskEmH3uzxm7gtYeZTFzzxuf_kTE7KtS3PnoPQ2D_ZmT7nQdpDd1nMyII Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 536cdbe85a4548b4ab38deeb771c920c Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:43:53.227411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:43:53.228929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_536cdbe85a4548b4ab38deeb771c920c", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:43:53.228929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:53.228929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 536cdbe85a4548b4ab38deeb771c920c Aug 05 20:43:53.228929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:53.228929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesNegativeTest-294111963-project Aug 05 20:43:53.228929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:43:53.228929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:43:53.228929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 75ce73cad1614c5fa96b7e95b36326e0 Aug 05 20:43:53.228929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesNegativeTest-294111963-project Aug 05 20:43:53.228929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Aug 05 20:43:53.228929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-891224262", "metadata": {"Type": "work"}}} Aug 05 20:43:53.228929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: Aug 05 20:43:53.228929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-891224262', 'metadata': {'Type': 'work'}}}} Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise error Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi '0' Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:43:53.229667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 20:43:53.230984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 20:43:53.234151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 20:43:53.234151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.234151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0adda001-7a45-4eab-a599-4669c0322774 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:43:53.235656 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0adda001-7a45-4eab-a599-4669c0322774 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.028714 Aug 05 20:43:53.238462 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 2/2] 10.222.0.100 () {60 vars in 1161 bytes} [Fri Aug 5 20:43:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:43:53.250652 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cc2a0100-ee8b-4560-be98-90231e639dd3 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Action: 'create', calling method: .version_select at 0x7f9bed6279d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1040436190", "metadata": {"Type": "work"}}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cc2a0100-ee8b-4560-be98-90231e639dd3 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Request method failure captured: Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 119 Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEH1UhAYPDz4g02MpQ1du75xnlR_NmI52j0XfH_9HVvfHAL794PJSj_OzPE-WeX61YQcHR6NRjiLGsVyq9pZwtPwnRwYoWhTkmPQ3WpwKNtzkorML1njclskEmH3uzxm7gtYeZTFzzxuf_kTE7KtS3PnoPQ2D_ZmT7nQdpDd1nMyII Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 536cdbe85a4548b4ab38deeb771c920c Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:43:53.255082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:43:53.256457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_536cdbe85a4548b4ab38deeb771c920c", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:43:53.256457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:53.256457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 536cdbe85a4548b4ab38deeb771c920c Aug 05 20:43:53.256457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:53.256457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesNegativeTest-294111963-project Aug 05 20:43:53.256457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:43:53.256457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:43:53.256457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 75ce73cad1614c5fa96b7e95b36326e0 Aug 05 20:43:53.256457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesNegativeTest-294111963-project Aug 05 20:43:53.256457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Aug 05 20:43:53.256457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1040436190", "metadata": {"Type": "work"}}} Aug 05 20:43:53.256457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: Aug 05 20:43:53.256457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1040436190', 'metadata': {'Type': 'work'}}}} Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise error Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi '' Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:43:53.257436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 20:43:53.259320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 20:43:53.261223 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 20:43:53.261223 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:53.261223 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cc2a0100-ee8b-4560-be98-90231e639dd3 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:43:53.261223 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cc2a0100-ee8b-4560-be98-90231e639dd3 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012317 Aug 05 20:43:53.261223 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 3/3] 10.222.0.100 () {60 vars in 1161 bytes} [Fri Aug 5 20:43:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:43:53.272479 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-da07ed4e-7b4f-4189-98e7-245439830d77 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Calling method '.version_select at 0x7f9bed627670>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:53.623583 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-26532177-4c81-4ab0-9978-963d5433905c tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.739510 Aug 05 20:43:53.636376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 1/4] 10.222.0.100 () {60 vars in 1161 bytes} [Fri Aug 5 20:43:49 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3754 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 05 20:43:53.642387 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-075b5b6a-3b1a-46b0-9703-98a323d74404 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] Calling method '.version_select at 0x7f9bed65dca0>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:53.747767 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-075b5b6a-3b1a-46b0-9703-98a323d74404 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/d6f7ce27-c4c7-4434-8a82-786773d59500" status: 200 len: 351 microversion: 2.1 time: 0.109704 Aug 05 20:43:53.748390 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 2/5] 10.222.0.100 () {58 vars in 1250 bytes} [Fri Aug 5 20:43:53 2022] GET /compute/v2.1/os-volumes/d6f7ce27-c4c7-4434-8a82-786773d59500 => generated 351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:43:53.753610 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ec1a6d0d-8d30-4964-8a34-5bd6063883c5 tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] Calling method '.version_select at 0x7f9bed5f7430>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:54.081215 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-da07ed4e-7b4f-4189-98e7-245439830d77 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] HTTP exception thrown: Volume tempest-invalid-1383256011 could not be found. Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-da07ed4e-7b4f-4189-98e7-245439830d77 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Request method failure captured: Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1383256011 HTTP/1.1 Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEH1UhAYPDz4g02MpQ1du75xnlR_NmI52j0XfH_9HVvfHAL794PJSj_OzPE-WeX61YQcHR6NRjiLGsVyq9pZwtPwnRwYoWhTkmPQ3WpwKNtzkorML1njclskEmH3uzxm7gtYeZTFzzxuf_kTE7KtS3PnoPQ2D_ZmT7nQdpDd1nMyII Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 536cdbe85a4548b4ab38deeb771c920c Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:43:54.086084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:43:54.087303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_536cdbe85a4548b4ab38deeb771c920c", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:43:54.087303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:54.087303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 536cdbe85a4548b4ab38deeb771c920c Aug 05 20:43:54.087303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:54.087303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesNegativeTest-294111963-project Aug 05 20:43:54.087303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:43:54.087303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:43:54.087303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 75ce73cad1614c5fa96b7e95b36326e0 Aug 05 20:43:54.087303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesNegativeTest-294111963-project Aug 05 20:43:54.087303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: Aug 05 20:43:54.087303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Volume tempest-invalid-1383256011 could not be found. Aug 05 20:43:54.087303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': 'tempest-invalid-1383256011'} Aug 05 20:43:54.087303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1383256011 could not be found. (HTTP 404) (Request-ID: req-32d9d31b-c5a0-4275-8d5a-06a3b64b1724) Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:54.088317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:43:54.089653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1383256011 could not be found. Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:43:54.090770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1383256011 could not be found. Aug 05 20:43:54.091930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.091930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:54.091930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.091930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:54.091930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:43:54.091930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:43:54.091930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:43:54.091930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:43:54.091930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1383256011 could not be found. Aug 05 20:43:54.091930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.094719 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-da07ed4e-7b4f-4189-98e7-245439830d77 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Returning 404 to user: Volume tempest-invalid-1383256011 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:43:54.095988 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-da07ed4e-7b4f-4189-98e7-245439830d77 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1383256011" status: 404 len: 99 microversion: 2.1 time: 0.831640 Aug 05 20:43:54.096947 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 4/6] 10.222.0.100 () {58 vars in 1223 bytes} [Fri Aug 5 20:43:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1383256011 => generated 99 bytes in 833 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 05 20:43:54.107446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3431e1e8-a6ab-4273-854f-55656c7e3473 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004131 Aug 05 20:43:54.112053 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 5/7] 10.222.0.100 () {58 vars in 1145 bytes} [Fri Aug 5 20:43:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 20:43:54.128970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-503a2b39-8337-41b3-9986-9795d794b1ab tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008353 Aug 05 20:43:54.131039 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 6/8] 10.222.0.100 () {58 vars in 1142 bytes} [Fri Aug 5 20:43:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 20:43:54.142679 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3a959bec-7a38-4217-8d35-36d1f5f04048 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Calling method '.version_select at 0x7f9bed570ca0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:54.244740 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ec1a6d0d-8d30-4964-8a34-5bd6063883c5 tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/419b21ba-2f98-41eb-8554-39e4726c6538" status: 200 len: 353 microversion: 2.1 time: 0.495023 Aug 05 20:43:54.253318 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 3/9] 10.222.0.100 () {58 vars in 1250 bytes} [Fri Aug 5 20:43:53 2022] GET /compute/v2.1/os-volumes/419b21ba-2f98-41eb-8554-39e4726c6538 => generated 353 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:43:54.258196 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-44cf89ae-1bd4-4485-9505-a6fe0c4afd97 tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] Calling method '.version_select at 0x7f9bed5f7af0>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:54.421753 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-3a959bec-7a38-4217-8d35-36d1f5f04048 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] HTTP exception thrown: Volume 32fd2db7-7d46-4f13-ab5e-4bd18e5953b3 could not be found. Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3a959bec-7a38-4217-8d35-36d1f5f04048 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Request method failure captured: Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/os-volumes/32fd2db7-7d46-4f13-ab5e-4bd18e5953b3 HTTP/1.1 Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEH1UhAYPDz4g02MpQ1du75xnlR_NmI52j0XfH_9HVvfHAL794PJSj_OzPE-WeX61YQcHR6NRjiLGsVyq9pZwtPwnRwYoWhTkmPQ3WpwKNtzkorML1njclskEmH3uzxm7gtYeZTFzzxuf_kTE7KtS3PnoPQ2D_ZmT7nQdpDd1nMyII Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 536cdbe85a4548b4ab38deeb771c920c Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:43:54.425120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:43:54.426678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_536cdbe85a4548b4ab38deeb771c920c", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:43:54.426678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:54.426678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 536cdbe85a4548b4ab38deeb771c920c Aug 05 20:43:54.426678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:54.426678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesNegativeTest-294111963-project Aug 05 20:43:54.426678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:43:54.426678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:43:54.426678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 75ce73cad1614c5fa96b7e95b36326e0 Aug 05 20:43:54.426678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesNegativeTest-294111963-project Aug 05 20:43:54.426678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: Aug 05 20:43:54.426678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Volume 32fd2db7-7d46-4f13-ab5e-4bd18e5953b3 could not be found. Aug 05 20:43:54.426678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '32fd2db7-7d46-4f13-ab5e-4bd18e5953b3'} Aug 05 20:43:54.426678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32fd2db7-7d46-4f13-ab5e-4bd18e5953b3 could not be found. (HTTP 404) (Request-ID: req-e257cebc-a009-4eb7-9c3b-dbd77101f069) Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:54.427609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:43:54.429027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32fd2db7-7d46-4f13-ab5e-4bd18e5953b3 could not be found. Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 20:43:54.430474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:43:54.432724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32fd2db7-7d46-4f13-ab5e-4bd18e5953b3 could not be found. Aug 05 20:43:54.432724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.432724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:54.432724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.432724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:54.432724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:43:54.432724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:43:54.432724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:43:54.432724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:43:54.432724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32fd2db7-7d46-4f13-ab5e-4bd18e5953b3 could not be found. Aug 05 20:43:54.432724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.432724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3a959bec-7a38-4217-8d35-36d1f5f04048 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Returning 404 to user: Volume 32fd2db7-7d46-4f13-ab5e-4bd18e5953b3 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:43:54.432724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3a959bec-7a38-4217-8d35-36d1f5f04048 tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/32fd2db7-7d46-4f13-ab5e-4bd18e5953b3" status: 404 len: 109 microversion: 2.1 time: 0.295582 Aug 05 20:43:54.434856 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 7/10] 10.222.0.100 () {58 vars in 1253 bytes} [Fri Aug 5 20:43:54 2022] DELETE /compute/v2.1/os-volumes/32fd2db7-7d46-4f13-ab5e-4bd18e5953b3 => generated 109 bytes in 299 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:43:54.446069 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5a426cf1-0119-4508-824c-5b14c7bfdfbf tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Calling method '.version_select at 0x7f9bed570d30>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:54.490291 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-44cf89ae-1bd4-4485-9505-a6fe0c4afd97 tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/419b21ba-2f98-41eb-8554-39e4726c6538" status: 200 len: 353 microversion: 2.1 time: 0.235437 Aug 05 20:43:54.513302 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 4/11] 10.222.0.100 () {58 vars in 1250 bytes} [Fri Aug 5 20:43:54 2022] GET /compute/v2.1/os-volumes/419b21ba-2f98-41eb-8554-39e4726c6538 => generated 353 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:43:54.525162 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a9727572-3df2-4d52-a554-91d26f6441a9 tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] Calling method '.version_select at 0x7f9bed65dd30>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:54.622552 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-5a426cf1-0119-4508-824c-5b14c7bfdfbf tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] HTTP exception thrown: Volume 58ffd25f-4060-4dbf-be32-111c548b3686 could not be found. Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5a426cf1-0119-4508-824c-5b14c7bfdfbf tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Request method failure captured: Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/os-volumes/58ffd25f-4060-4dbf-be32-111c548b3686 HTTP/1.1 Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEH1UhAYPDz4g02MpQ1du75xnlR_NmI52j0XfH_9HVvfHAL794PJSj_OzPE-WeX61YQcHR6NRjiLGsVyq9pZwtPwnRwYoWhTkmPQ3WpwKNtzkorML1njclskEmH3uzxm7gtYeZTFzzxuf_kTE7KtS3PnoPQ2D_ZmT7nQdpDd1nMyII Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 536cdbe85a4548b4ab38deeb771c920c Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:43:54.626418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:43:54.628060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/536cdbe85a4548b4ab38deeb771c920c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_536cdbe85a4548b4ab38deeb771c920c", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:43:54.628060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:54.628060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 536cdbe85a4548b4ab38deeb771c920c Aug 05 20:43:54.628060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesNegativeTest-294111963 Aug 05 20:43:54.628060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesNegativeTest-294111963-project Aug 05 20:43:54.628060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:43:54.628060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:43:54.628060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 75ce73cad1614c5fa96b7e95b36326e0 Aug 05 20:43:54.628060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesNegativeTest-294111963-project Aug 05 20:43:54.628060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: Aug 05 20:43:54.628060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Volume 58ffd25f-4060-4dbf-be32-111c548b3686 could not be found. Aug 05 20:43:54.628060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '58ffd25f-4060-4dbf-be32-111c548b3686'} Aug 05 20:43:54.628060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58ffd25f-4060-4dbf-be32-111c548b3686 could not be found. (HTTP 404) (Request-ID: req-e4ab0fff-a778-465c-97e5-eea24b903eb1) Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:54.628851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:43:54.630091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58ffd25f-4060-4dbf-be32-111c548b3686 could not be found. Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 20:43:54.631342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:43:54.632896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58ffd25f-4060-4dbf-be32-111c548b3686 could not be found. Aug 05 20:43:54.632896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.632896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:54.632896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.632896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:54.632896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:43:54.632896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:43:54.632896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:43:54.632896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:43:54.632896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58ffd25f-4060-4dbf-be32-111c548b3686 could not be found. Aug 05 20:43:54.632896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:43:54.632896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5a426cf1-0119-4508-824c-5b14c7bfdfbf tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] Returning 404 to user: Volume 58ffd25f-4060-4dbf-be32-111c548b3686 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:43:54.635433 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5a426cf1-0119-4508-824c-5b14c7bfdfbf tempest-VolumesNegativeTest-294111963 tempest-VolumesNegativeTest-294111963-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/58ffd25f-4060-4dbf-be32-111c548b3686" status: 404 len: 109 microversion: 2.1 time: 0.194179 Aug 05 20:43:54.645566 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 8/12] 10.222.0.100 () {58 vars in 1250 bytes} [Fri Aug 5 20:43:54 2022] GET /compute/v2.1/os-volumes/58ffd25f-4060-4dbf-be32-111c548b3686 => generated 109 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:43:54.803061 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a9727572-3df2-4d52-a554-91d26f6441a9 tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/419b21ba-2f98-41eb-8554-39e4726c6538" status: 202 len: 0 microversion: 2.1 time: 0.283426 Aug 05 20:43:54.804269 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 5/13] 10.222.0.100 () {58 vars in 1253 bytes} [Fri Aug 5 20:43:54 2022] DELETE /compute/v2.1/os-volumes/419b21ba-2f98-41eb-8554-39e4726c6538 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:43:54.815582 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d37c8b9e-c1e0-433a-9801-561d458b2f50 tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] Calling method '.version_select at 0x7f9bed627280>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:54.970407 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d37c8b9e-c1e0-433a-9801-561d458b2f50 tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/419b21ba-2f98-41eb-8554-39e4726c6538" status: 200 len: 352 microversion: 2.1 time: 0.161849 Aug 05 20:43:54.971237 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 9/14] 10.222.0.100 () {58 vars in 1250 bytes} [Fri Aug 5 20:43:54 2022] GET /compute/v2.1/os-volumes/419b21ba-2f98-41eb-8554-39e4726c6538 => generated 352 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:43:55.984948 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-702c40ac-426d-45c5-a32e-e4cb89352128 tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] Calling method '.version_select at 0x7f9bed5f7b80>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:56.029401 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-76935574-600c-4026-96ab-fd86eb7da755 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] Calling method '.version_select at 0x7f9bed5701f0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:56.076790 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-702c40ac-426d-45c5-a32e-e4cb89352128 tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] HTTP exception thrown: Volume 419b21ba-2f98-41eb-8554-39e4726c6538 could not be found. Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-702c40ac-426d-45c5-a32e-e4cb89352128 tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] Request method failure captured: Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/os-volumes/419b21ba-2f98-41eb-8554-39e4726c6538 HTTP/1.1 Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEF3NoQIL02fH8xcIuhYEa1gwniUwU9kR9k73SHC4UEWBvkRFcsHb9DZoUE_cED0PKZpU4dFSOv6TMwkyx69Mg8Nh_yUPU34OHPgBRUg7XcjgUArPaCcrzskE5A2S02AGDdjDhz4Iq-haRmy1NQL0QmltdEEBoMTGoNsoJhQQyeYX8 Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 0f42e5cd81d449efba58439d05cc0e59 Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-VolumesGetTestJSON-1065363934 Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:43:56.081229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:43:56.082574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0f42e5cd81d449efba58439d05cc0e59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0f42e5cd81d449efba58439d05cc0e59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0f42e5cd81d449efba58439d05cc0e59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0f42e5cd81d449efba58439d05cc0e59", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:43:56.082574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-VolumesGetTestJSON-1065363934 Aug 05 20:43:56.082574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 0f42e5cd81d449efba58439d05cc0e59 Aug 05 20:43:56.082574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-VolumesGetTestJSON-1065363934 Aug 05 20:43:56.082574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-VolumesGetTestJSON-1065363934-project Aug 05 20:43:56.082574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:43:56.082574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:43:56.082574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 9e882fe2f76f4d2a806f2438c492ae0d Aug 05 20:43:56.082574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-VolumesGetTestJSON-1065363934-project Aug 05 20:43:56.082574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: Aug 05 20:43:56.082574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Volume 419b21ba-2f98-41eb-8554-39e4726c6538 could not be found. Aug 05 20:43:56.082574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '419b21ba-2f98-41eb-8554-39e4726c6538'} Aug 05 20:43:56.082574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 419b21ba-2f98-41eb-8554-39e4726c6538 could not be found. (HTTP 404) (Request-ID: req-73158d5d-2618-45d9-bd93-8ad86bb14686) Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:56.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:43:56.084045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 419b21ba-2f98-41eb-8554-39e4726c6538 could not be found. Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 20:43:56.084857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:43:56.087759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 419b21ba-2f98-41eb-8554-39e4726c6538 could not be found. Aug 05 20:43:56.087759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:43:56.087759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:43:56.087759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:43:56.087759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:43:56.087759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:43:56.087759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:43:56.087759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:43:56.087759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:43:56.087759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 419b21ba-2f98-41eb-8554-39e4726c6538 could not be found. Aug 05 20:43:56.087759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:43:56.087759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-702c40ac-426d-45c5-a32e-e4cb89352128 tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] Returning 404 to user: Volume 419b21ba-2f98-41eb-8554-39e4726c6538 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:43:56.087759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-702c40ac-426d-45c5-a32e-e4cb89352128 tempest-VolumesGetTestJSON-1065363934 tempest-VolumesGetTestJSON-1065363934-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/419b21ba-2f98-41eb-8554-39e4726c6538" status: 404 len: 109 microversion: 2.1 time: 0.101704 Aug 05 20:43:56.087759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 6/15] 10.222.0.100 () {58 vars in 1250 bytes} [Fri Aug 5 20:43:55 2022] GET /compute/v2.1/os-volumes/419b21ba-2f98-41eb-8554-39e4726c6538 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:43:56.135584 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-76935574-600c-4026-96ab-fd86eb7da755 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/0a210859-b753-4b34-963f-45ebd890446f" status: 200 len: 350 microversion: 2.1 time: 0.110140 Aug 05 20:43:56.137351 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 10/16] 10.222.0.100 () {58 vars in 1250 bytes} [Fri Aug 5 20:43:56 2022] GET /compute/v2.1/os-volumes/0a210859-b753-4b34-963f-45ebd890446f => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:43:58.163678 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-5782a116-987a-4b25-b7bb-cb6c3fbe5e62 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] Calling method '.version_select at 0x7f9bed564550>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:58.284432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-5782a116-987a-4b25-b7bb-cb6c3fbe5e62 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/f326e3ea-e77f-41b5-861b-af6cf5707c70" status: 200 len: 351 microversion: 2.1 time: 0.125355 Aug 05 20:43:58.284432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 7/17] 10.222.0.100 () {58 vars in 1250 bytes} [Fri Aug 5 20:43:58 2022] GET /compute/v2.1/os-volumes/f326e3ea-e77f-41b5-861b-af6cf5707c70 => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:43:58.297645 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b8c71e46-295f-4749-a1a0-741647074cb7 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] Calling method '.version_select at 0x7f9bed58f280>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:58.555220 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b8c71e46-295f-4749-a1a0-741647074cb7 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] 10.222.0.100 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.260379 Aug 05 20:43:58.556472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 11/18] 10.222.0.100 () {58 vars in 1139 bytes} [Fri Aug 5 20:43:58 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:43:58.570230 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d7c47ff9-11c1-4d9a-b803-b0db37951e60 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] Calling method '.version_select at 0x7f9bed564c10>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:58.827089 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d7c47ff9-11c1-4d9a-b803-b0db37951e60 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] 10.222.0.100 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.260344 Aug 05 20:43:58.827965 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 8/19] 10.222.0.100 () {58 vars in 1154 bytes} [Fri Aug 5 20:43:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:43:58.843011 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2833eb94-a3fc-4bda-b8d2-862588bad001 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] Calling method '.version_select at 0x7f9bed58c1f0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:59.138910 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2833eb94-a3fc-4bda-b8d2-862588bad001 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] 10.222.0.100 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.301650 Aug 05 20:43:59.140116 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 12/20] 10.222.0.100 () {58 vars in 1139 bytes} [Fri Aug 5 20:43:58 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:43:59.156128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3e877259-9cc3-4d83-83b4-579f8bb8b01e tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] Calling method '.version_select at 0x7f9bed564ee0>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:59.500709 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3e877259-9cc3-4d83-83b4-579f8bb8b01e tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] 10.222.0.100 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.349424 Aug 05 20:43:59.504462 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 9/21] 10.222.0.100 () {58 vars in 1172 bytes} [Fri Aug 5 20:43:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:43:59.528510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ee007e4c-e315-42f6-9a7f-32d10e37dd9a tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] Calling method '.version_select at 0x7f9bed5701f0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:43:59.901584 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ee007e4c-e315-42f6-9a7f-32d10e37dd9a tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.384841 Aug 05 20:43:59.902748 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 13/22] 10.222.0.100 () {58 vars in 1175 bytes} [Fri Aug 5 20:43:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:43:59.923386 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9a51536d-8b57-41bf-914d-5508e9c1e63b tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] Calling method '.version_select at 0x7f9bed56c550>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:00.216473 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9a51536d-8b57-41bf-914d-5508e9c1e63b tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.297835 Aug 05 20:44:00.218186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 10/23] 10.222.0.100 () {58 vars in 1160 bytes} [Fri Aug 5 20:43:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:00.245312 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fbaf968b-02de-4414-b53e-0231c1aa19b4 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] Calling method '.version_select at 0x7f9bed58f1f0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:00.632484 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fbaf968b-02de-4414-b53e-0231c1aa19b4 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.403668 Aug 05 20:44:00.634385 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 14/24] 10.222.0.100 () {58 vars in 1193 bytes} [Fri Aug 5 20:44:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:44:00.649806 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a5898d29-6c2d-4f78-87f6-38b4ef6af991 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] Calling method '.version_select at 0x7f9bed574820>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:01.010457 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a5898d29-6c2d-4f78-87f6-38b4ef6af991 tempest-VolumesTestJSON-1000790119 tempest-VolumesTestJSON-1000790119-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.365752 Aug 05 20:44:01.012226 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 11/25] 10.222.0.100 () {58 vars in 1160 bytes} [Fri Aug 5 20:44:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:06.307830 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3767e463-2aa4-40ea-af78-5d276efddb35 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Action: 'create', calling method: .version_select at 0x7f9bed5903a0>, body: {"keypair": {"name": "tempest-keypair-1331983520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZjgh1YUEsgX3mX9j/DzbULVonvoMj8W+NUIXaLT8EqF3desKpRF+CGyafm1jv/EFeQRBUDlSUXtEKCerPiRnxxiqJcivdn94viqegcHx7nSexizj/zWXjRVPU8n3TuMw=="}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:06.484535 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-3767e463-2aa4-40ea-af78-5d276efddb35 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for project 8b67138a484f481099c562d7e3ca8401. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:44:06.512612 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-3767e463-2aa4-40ea-af78-5d276efddb35 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for user 8e1baad75342476aa0c64bda0414e334 and project 8b67138a484f481099c562d7e3ca8401. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:44:06.628070 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3767e463-2aa4-40ea-af78-5d276efddb35 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.108407 Aug 05 20:44:06.638194 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 15/26] 10.222.0.100 () {60 vars in 1164 bytes} [Fri Aug 5 20:44:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:44:08.372719 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8fa591d0-d1c8-415d-987e-43672364303b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Action: 'create', calling method: .version_select at 0x7f9bed83ff70>, body: {"keypair": {"name": "tempest-keypair-205549469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtUV5b4uWdlehKKdyBVf+r9cgHkLvr9YsgqhSCnxSi0piRCm9s0/QcF+ist6Knp/BRz8jBizqCGkSggXLG7QhfN9Vf0kDdQFrHojx5Z34pQ34vfYRT2EpcKU74g8162+w=="}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:08.522793 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-8fa591d0-d1c8-415d-987e-43672364303b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Getting quotas for project 2ae12b8f8a7f40758ca0edaeea7022ab. Resources: {'key_pairs'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:44:08.532411 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-8fa591d0-d1c8-415d-987e-43672364303b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Getting quotas for user 396a79cbb4e9494791422713c596bc0c and project 2ae12b8f8a7f40758ca0edaeea7022ab. Resources: {'key_pairs'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:44:08.651924 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8fa591d0-d1c8-415d-987e-43672364303b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.880161 Aug 05 20:44:08.654254 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 12/27] 10.222.0.100 () {60 vars in 1164 bytes} [Fri Aug 5 20:44:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:44:12.122897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2c0a8c40-c487-4451-8f1c-7148953a605a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Action: 'create', calling method: .version_select at 0x7f9bed5578b0>, body: {"keypair": {"name": "tempest-keypair-499650073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBp3ojnRLogAF+4296GjSDMlLqVZ9505SJqk6De34LTZ1QE/NHCLZ/ePMdRu/SE0JB3WWHl4WkXJvlJE9MnOj/28JeUqchQboM6QW6zXNnBnQoT9k5lYcKBAU3M1h7AXYA=="}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:12.168784 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-2c0a8c40-c487-4451-8f1c-7148953a605a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Getting quotas for project c687166988fc4513a81e536a8f38ca3e. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:44:12.187064 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-2c0a8c40-c487-4451-8f1c-7148953a605a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Getting quotas for user 44ac4775be0244df8fa0ee51a765c03a and project c687166988fc4513a81e536a8f38ca3e. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:44:12.236231 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2c0a8c40-c487-4451-8f1c-7148953a605a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.411670 Aug 05 20:44:12.236231 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 16/28] 10.222.0.100 () {62 vars in 1205 bytes} [Fri Aug 5 20:44:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 413 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 20:44:12.582596 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1549534989", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9bbc8caf-4605-4dc8-9bf5-6e59e633b041"}], "security_groups": [{"name": "tempest-securitygroup--344679609"}], "key_name": "tempest-keypair-1331983520", "user_data": "}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:13.045133 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.network.neutron [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] validate_networks() for [('9bbc8caf-4605-4dc8-9bf5-6e59e633b041', None, None, None, None, None)] {{(pid=124431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:44:13.804116 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1146756777", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "networks": [{"uuid": "e49b3a05-ad08-4a70-9382-8180b948c956"}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:14.007420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] validate_networks() for [('e49b3a05-ad08-4a70-9382-8180b948c956', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:44:17.682267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Flavor limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:44:17.682873 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Image limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:44:17.683413 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Flavor pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:44:17.684322 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Image pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:44:17.684322 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:44:17.713901 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:17.724458 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:17.724922 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:17.726097 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:17.726552 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:17.726987 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:17.833075 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for project 8b67138a484f481099c562d7e3ca8401. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:44:17.857319 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for user 8e1baad75342476aa0c64bda0414e334 and project 8b67138a484f481099c562d7e3ca8401. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:44:17.943874 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Going to run 1 instances... {{(pid=124431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:44:17.965344 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:44:18.096290 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:44:18.097032 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:44:18.097520 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:44:18.097985 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:44:18.098487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:44:18.118659 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:18.124335 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:18.125962 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:18.126871 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:18.128965 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:18.129626 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:18.166856 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Getting quotas for project 46c32ca23c17400fb5388a652efacc54. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:44:18.173794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Getting quotas for user 4dc2f277a1d04094a77c6a0c90420f4a and project 46c32ca23c17400fb5388a652efacc54. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:44:18.186423 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8a31fdaa-a851-44e3-b3d5-ff033476903f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 5.608196 Aug 05 20:44:18.193713 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 13/29] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:44:12 2022] POST /compute/v2.1/servers => generated 403 bytes in 5611 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:44:18.207020 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-135018786", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d117834c-4f6c-451a-85e5-111d70dc09dc"}], "security_groups": [{"name": "tempest-securitygroup--432370300"}], "key_name": "tempest-keypair-499650073", "user_data": "}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:18.250290 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:44:18.264840 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:44:18.526102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.network.neutron [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] validate_networks() for [('d117834c-4f6c-451a-85e5-111d70dc09dc', None, None, None, None, None)] {{(pid=124431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:44:18.558165 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-271799fe-b22a-46f4-aae1-65326c3a8e5c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 5.256915 Aug 05 20:44:18.561928 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 17/30] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:44:13 2022] POST /compute/v2.1/servers => generated 382 bytes in 5261 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:44:18.584643 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1908700675", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf8c0cd9-83e1-49c1-9653-160ea22387f7"}], "security_groups": [{"name": "tempest-securitygroup--572798917"}], "key_name": "tempest-keypair-205549469", "user_data": "}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:18.900929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] validate_networks() for [('cf8c0cd9-83e1-49c1-9653-160ea22387f7', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:44:20.164404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Flavor limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:44:20.164981 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Image limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:44:20.165290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Flavor pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:44:20.165703 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Image pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:44:20.166113 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:44:20.180661 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:20.181155 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:20.181597 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:20.182323 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:20.182778 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:20.183203 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:20.257020 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Getting quotas for project c687166988fc4513a81e536a8f38ca3e. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:44:20.272861 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Getting quotas for user 44ac4775be0244df8fa0ee51a765c03a and project c687166988fc4513a81e536a8f38ca3e. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:44:20.316462 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Going to run 1 instances... {{(pid=124431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:44:20.321338 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:44:20.352191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:44:20.352687 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:44:20.353166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:44:20.353583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:44:20.354270 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:44:20.370532 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:20.372393 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:20.373213 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:20.373974 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:20.378347 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:20.378905 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:20.420734 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Getting quotas for project 2ae12b8f8a7f40758ca0edaeea7022ab. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:44:20.432797 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Getting quotas for user 396a79cbb4e9494791422713c596bc0c and project 2ae12b8f8a7f40758ca0edaeea7022ab. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:44:20.462528 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:44:20.468063 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:44:20.551545 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a68a098e-c5f7-484a-9926-20efeb16deb2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 2.353354 Aug 05 20:44:20.556037 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 14/31] 10.222.0.100 () {62 vars in 1193 bytes} [Fri Aug 5 20:44:18 2022] POST /compute/v2.1/servers => generated 403 bytes in 2367 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 05 20:44:20.567431 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-73519a1f-8f9b-476f-a831-7e41c746f66f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:20.568195 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-73519a1f-8f9b-476f-a831-7e41c746f66f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:20.613419 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fe1ae849-4f71-44a6-be40-f07476331b14 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.042960 Aug 05 20:44:20.620548 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 18/32] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:44:18 2022] POST /compute/v2.1/servers => generated 403 bytes in 2052 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:44:20.624958 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b9a91243-3bcc-4346-82b9-f3b1bef7733f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:20.625583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b9a91243-3bcc-4346-82b9-f3b1bef7733f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:20.654536 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b9a91243-3bcc-4346-82b9-f3b1bef7733f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:20.655044 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b9a91243-3bcc-4346-82b9-f3b1bef7733f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:20.655524 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b9a91243-3bcc-4346-82b9-f3b1bef7733f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:20.659105 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b9a91243-3bcc-4346-82b9-f3b1bef7733f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:20.661420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b9a91243-3bcc-4346-82b9-f3b1bef7733f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:20.664359 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b9a91243-3bcc-4346-82b9-f3b1bef7733f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:20.683299 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-73519a1f-8f9b-476f-a831-7e41c746f66f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:20.685939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-73519a1f-8f9b-476f-a831-7e41c746f66f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:20.687326 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-73519a1f-8f9b-476f-a831-7e41c746f66f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:20.689486 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-73519a1f-8f9b-476f-a831-7e41c746f66f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:20.690911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-73519a1f-8f9b-476f-a831-7e41c746f66f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:20.692069 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-73519a1f-8f9b-476f-a831-7e41c746f66f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:21.015526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b9a91243-3bcc-4346-82b9-f3b1bef7733f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:21.035332 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b9a91243-3bcc-4346-82b9-f3b1bef7733f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1215 microversion: 2.1 time: 0.418945 Aug 05 20:44:21.040823 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 19/33] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:20 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1215 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:21.087036 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8abd5c32-1b34-4007-8fc9-09eb07c9feea tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:21.090375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8abd5c32-1b34-4007-8fc9-09eb07c9feea tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:21.361953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8abd5c32-1b34-4007-8fc9-09eb07c9feea tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:21.394638 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8abd5c32-1b34-4007-8fc9-09eb07c9feea tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:21.402656 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8abd5c32-1b34-4007-8fc9-09eb07c9feea tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:21.405834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8abd5c32-1b34-4007-8fc9-09eb07c9feea tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1284 microversion: 2.20 time: 0.349905 Aug 05 20:44:21.409746 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 20/34] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:21 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1284 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:21.430036 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0a0fdc0e-e67d-45b1-ada9-5983c8b9d941 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:21.430694 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0a0fdc0e-e67d-45b1-ada9-5983c8b9d941 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:21.431784 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-73519a1f-8f9b-476f-a831-7e41c746f66f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:21.480136 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-73519a1f-8f9b-476f-a831-7e41c746f66f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1242 microversion: 2.1 time: 0.921826 Aug 05 20:44:21.483716 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 15/35] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:20 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1242 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:21.590297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0a0fdc0e-e67d-45b1-ada9-5983c8b9d941 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:21.604573 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0a0fdc0e-e67d-45b1-ada9-5983c8b9d941 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1241 microversion: 2.1 time: 0.192876 Aug 05 20:44:21.605002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 21/36] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:21 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1241 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:22.066542 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-349a4ae1-21ca-4552-894b-6021c5d51b59 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:22.067294 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-349a4ae1-21ca-4552-894b-6021c5d51b59 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:22.074372 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-349a4ae1-21ca-4552-894b-6021c5d51b59 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:22.074855 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-349a4ae1-21ca-4552-894b-6021c5d51b59 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:22.075310 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-349a4ae1-21ca-4552-894b-6021c5d51b59 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:22.076107 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-349a4ae1-21ca-4552-894b-6021c5d51b59 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:22.076563 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-349a4ae1-21ca-4552-894b-6021c5d51b59 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:22.076988 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-349a4ae1-21ca-4552-894b-6021c5d51b59 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:22.155199 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-349a4ae1-21ca-4552-894b-6021c5d51b59 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:22.163922 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-349a4ae1-21ca-4552-894b-6021c5d51b59 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1215 microversion: 2.1 time: 0.101336 Aug 05 20:44:22.164547 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 16/37] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:22 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:22.439787 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-010f9a1a-5bd2-43f7-b1d2-b7bea7b79e2d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:22.440358 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-010f9a1a-5bd2-43f7-b1d2-b7bea7b79e2d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:22.449351 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-010f9a1a-5bd2-43f7-b1d2-b7bea7b79e2d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:22.450177 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-010f9a1a-5bd2-43f7-b1d2-b7bea7b79e2d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:22.450869 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-010f9a1a-5bd2-43f7-b1d2-b7bea7b79e2d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:22.451918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-010f9a1a-5bd2-43f7-b1d2-b7bea7b79e2d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:22.452375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-010f9a1a-5bd2-43f7-b1d2-b7bea7b79e2d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:22.452787 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-010f9a1a-5bd2-43f7-b1d2-b7bea7b79e2d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:22.503410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-cee3ecff-7c88-4656-99fd-3540026af72c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:22.504046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-cee3ecff-7c88-4656-99fd-3540026af72c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:22.512739 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cee3ecff-7c88-4656-99fd-3540026af72c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:22.517569 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cee3ecff-7c88-4656-99fd-3540026af72c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:22.517569 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cee3ecff-7c88-4656-99fd-3540026af72c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:22.517569 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cee3ecff-7c88-4656-99fd-3540026af72c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:22.517569 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cee3ecff-7c88-4656-99fd-3540026af72c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:22.517989 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cee3ecff-7c88-4656-99fd-3540026af72c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:22.526068 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-010f9a1a-5bd2-43f7-b1d2-b7bea7b79e2d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:22.551658 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-010f9a1a-5bd2-43f7-b1d2-b7bea7b79e2d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:22.553287 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-010f9a1a-5bd2-43f7-b1d2-b7bea7b79e2d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:22.554559 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-010f9a1a-5bd2-43f7-b1d2-b7bea7b79e2d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1288 microversion: 2.20 time: 0.118602 Aug 05 20:44:22.555395 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 22/38] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:22 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1288 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:44:22.597249 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-cee3ecff-7c88-4656-99fd-3540026af72c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:22.607865 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-cee3ecff-7c88-4656-99fd-3540026af72c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1242 microversion: 2.1 time: 0.108981 Aug 05 20:44:22.608477 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 17/39] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:22 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:44:22.630407 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4b4f7ecb-6766-413f-a0c3-fee1d0a39f9a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:22.631559 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4b4f7ecb-6766-413f-a0c3-fee1d0a39f9a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:22.642536 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4b4f7ecb-6766-413f-a0c3-fee1d0a39f9a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:22.643079 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4b4f7ecb-6766-413f-a0c3-fee1d0a39f9a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:22.643582 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4b4f7ecb-6766-413f-a0c3-fee1d0a39f9a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:22.644327 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4b4f7ecb-6766-413f-a0c3-fee1d0a39f9a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:22.644788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4b4f7ecb-6766-413f-a0c3-fee1d0a39f9a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:22.645231 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4b4f7ecb-6766-413f-a0c3-fee1d0a39f9a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:22.781977 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4b4f7ecb-6766-413f-a0c3-fee1d0a39f9a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:22.795566 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4b4f7ecb-6766-413f-a0c3-fee1d0a39f9a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1245 microversion: 2.1 time: 0.168949 Aug 05 20:44:22.796188 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 23/40] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:22 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1245 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:23.192752 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f4c7c1f8-e938-45d5-96f5-52a1f79bd297 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:23.196265 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f4c7c1f8-e938-45d5-96f5-52a1f79bd297 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:23.213350 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4c7c1f8-e938-45d5-96f5-52a1f79bd297 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:23.218174 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4c7c1f8-e938-45d5-96f5-52a1f79bd297 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:23.219641 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4c7c1f8-e938-45d5-96f5-52a1f79bd297 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:23.221319 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4c7c1f8-e938-45d5-96f5-52a1f79bd297 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:23.222418 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4c7c1f8-e938-45d5-96f5-52a1f79bd297 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:23.223559 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4c7c1f8-e938-45d5-96f5-52a1f79bd297 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:23.372203 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f4c7c1f8-e938-45d5-96f5-52a1f79bd297 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:23.387686 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f4c7c1f8-e938-45d5-96f5-52a1f79bd297 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1271 microversion: 2.1 time: 0.204771 Aug 05 20:44:23.388194 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 18/41] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:23 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:23.579309 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-626d8f4d-9cb0-4664-8945-f50939639dab tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:23.580109 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-626d8f4d-9cb0-4664-8945-f50939639dab tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:23.588575 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-626d8f4d-9cb0-4664-8945-f50939639dab tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:23.589063 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-626d8f4d-9cb0-4664-8945-f50939639dab tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:23.589495 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-626d8f4d-9cb0-4664-8945-f50939639dab tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:23.590191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-626d8f4d-9cb0-4664-8945-f50939639dab tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:23.590639 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-626d8f4d-9cb0-4664-8945-f50939639dab tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:23.591057 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-626d8f4d-9cb0-4664-8945-f50939639dab tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:23.640921 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9c2d8e50-65ca-4852-befd-24d6b7550e58 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:23.642253 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9c2d8e50-65ca-4852-befd-24d6b7550e58 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:23.650604 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c2d8e50-65ca-4852-befd-24d6b7550e58 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:23.653193 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c2d8e50-65ca-4852-befd-24d6b7550e58 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:23.653860 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c2d8e50-65ca-4852-befd-24d6b7550e58 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:23.654593 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c2d8e50-65ca-4852-befd-24d6b7550e58 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:23.657925 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c2d8e50-65ca-4852-befd-24d6b7550e58 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:23.658375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c2d8e50-65ca-4852-befd-24d6b7550e58 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:23.692767 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-626d8f4d-9cb0-4664-8945-f50939639dab tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:23.701395 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-626d8f4d-9cb0-4664-8945-f50939639dab tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:23.702958 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-626d8f4d-9cb0-4664-8945-f50939639dab tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:23.704124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-626d8f4d-9cb0-4664-8945-f50939639dab tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1280 microversion: 2.20 time: 0.128795 Aug 05 20:44:23.704681 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 24/42] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:23 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1280 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:44:23.736789 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-9c2d8e50-65ca-4852-befd-24d6b7550e58 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:23.746832 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9c2d8e50-65ca-4852-befd-24d6b7550e58 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1298 microversion: 2.1 time: 0.119637 Aug 05 20:44:23.747454 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 19/43] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:23 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:23.817184 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4c83f4a4-b62c-4cd1-9832-93bf2ffbcdd3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:23.818040 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4c83f4a4-b62c-4cd1-9832-93bf2ffbcdd3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:23.825539 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c83f4a4-b62c-4cd1-9832-93bf2ffbcdd3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:23.826062 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c83f4a4-b62c-4cd1-9832-93bf2ffbcdd3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:23.826570 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c83f4a4-b62c-4cd1-9832-93bf2ffbcdd3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:23.827493 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c83f4a4-b62c-4cd1-9832-93bf2ffbcdd3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:23.828221 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c83f4a4-b62c-4cd1-9832-93bf2ffbcdd3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:23.828662 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c83f4a4-b62c-4cd1-9832-93bf2ffbcdd3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:23.919215 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4c83f4a4-b62c-4cd1-9832-93bf2ffbcdd3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:23.930747 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4c83f4a4-b62c-4cd1-9832-93bf2ffbcdd3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1237 microversion: 2.1 time: 0.118455 Aug 05 20:44:23.931771 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 25/44] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:23 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1237 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:24.417938 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d45e1aaf-de36-47c0-94bc-58943798a16b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:24.418948 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d45e1aaf-de36-47c0-94bc-58943798a16b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:24.425567 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d45e1aaf-de36-47c0-94bc-58943798a16b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:24.426066 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d45e1aaf-de36-47c0-94bc-58943798a16b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:24.426503 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d45e1aaf-de36-47c0-94bc-58943798a16b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:24.427610 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d45e1aaf-de36-47c0-94bc-58943798a16b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:24.428448 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d45e1aaf-de36-47c0-94bc-58943798a16b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:24.428936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d45e1aaf-de36-47c0-94bc-58943798a16b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:24.503031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d45e1aaf-de36-47c0-94bc-58943798a16b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:24.512902 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d45e1aaf-de36-47c0-94bc-58943798a16b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1271 microversion: 2.1 time: 0.099482 Aug 05 20:44:24.513490 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 20/45] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:24 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:24.734308 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-62818242-ea94-4a36-9c9e-94c366808fda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:24.735690 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-62818242-ea94-4a36-9c9e-94c366808fda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:24.746508 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62818242-ea94-4a36-9c9e-94c366808fda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:24.747997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62818242-ea94-4a36-9c9e-94c366808fda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:24.749046 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62818242-ea94-4a36-9c9e-94c366808fda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:24.750488 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62818242-ea94-4a36-9c9e-94c366808fda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:24.751933 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62818242-ea94-4a36-9c9e-94c366808fda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:24.753046 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62818242-ea94-4a36-9c9e-94c366808fda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:24.774065 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-928c6210-1d68-418b-868d-c082b0ae3e79 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:24.776020 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-928c6210-1d68-418b-868d-c082b0ae3e79 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:24.787402 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-928c6210-1d68-418b-868d-c082b0ae3e79 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:24.788776 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-928c6210-1d68-418b-868d-c082b0ae3e79 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:24.789796 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-928c6210-1d68-418b-868d-c082b0ae3e79 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:24.791030 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-928c6210-1d68-418b-868d-c082b0ae3e79 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:24.792130 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-928c6210-1d68-418b-868d-c082b0ae3e79 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:24.793085 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-928c6210-1d68-418b-868d-c082b0ae3e79 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:24.847879 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-62818242-ea94-4a36-9c9e-94c366808fda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:24.861616 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-62818242-ea94-4a36-9c9e-94c366808fda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:24.863433 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-62818242-ea94-4a36-9c9e-94c366808fda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:24.864918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-62818242-ea94-4a36-9c9e-94c366808fda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1280 microversion: 2.20 time: 0.139985 Aug 05 20:44:24.865882 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 26/46] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:24 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1280 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:24.901249 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-928c6210-1d68-418b-868d-c082b0ae3e79 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:24.909627 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-928c6210-1d68-418b-868d-c082b0ae3e79 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1298 microversion: 2.1 time: 0.143069 Aug 05 20:44:24.910207 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 21/47] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:24 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1298 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:24.952713 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5ad2c95f-6d7f-4cfa-86c1-edfaac8c9c99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:24.953333 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5ad2c95f-6d7f-4cfa-86c1-edfaac8c9c99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:24.960936 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ad2c95f-6d7f-4cfa-86c1-edfaac8c9c99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:24.961437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ad2c95f-6d7f-4cfa-86c1-edfaac8c9c99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:24.961877 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ad2c95f-6d7f-4cfa-86c1-edfaac8c9c99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:24.962587 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ad2c95f-6d7f-4cfa-86c1-edfaac8c9c99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:24.963050 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ad2c95f-6d7f-4cfa-86c1-edfaac8c9c99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:24.963509 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ad2c95f-6d7f-4cfa-86c1-edfaac8c9c99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:25.030002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5ad2c95f-6d7f-4cfa-86c1-edfaac8c9c99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:25.037828 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5ad2c95f-6d7f-4cfa-86c1-edfaac8c9c99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1237 microversion: 2.1 time: 0.089041 Aug 05 20:44:25.038418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 27/48] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:24 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:25.536682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e0007c5a-2068-4baa-b0d6-d74617450971 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:25.537313 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e0007c5a-2068-4baa-b0d6-d74617450971 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:25.543704 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e0007c5a-2068-4baa-b0d6-d74617450971 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:25.544195 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e0007c5a-2068-4baa-b0d6-d74617450971 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:25.544606 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e0007c5a-2068-4baa-b0d6-d74617450971 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:25.545307 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e0007c5a-2068-4baa-b0d6-d74617450971 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:25.545757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e0007c5a-2068-4baa-b0d6-d74617450971 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:25.546193 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e0007c5a-2068-4baa-b0d6-d74617450971 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:25.612145 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-e0007c5a-2068-4baa-b0d6-d74617450971 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:25.621065 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e0007c5a-2068-4baa-b0d6-d74617450971 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1271 microversion: 2.1 time: 0.088308 Aug 05 20:44:25.621659 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 22/49] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:25 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:25.888828 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b43249e8-6b87-43ad-8453-8f48faffdcbc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:25.889447 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b43249e8-6b87-43ad-8453-8f48faffdcbc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:25.896088 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b43249e8-6b87-43ad-8453-8f48faffdcbc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:25.896600 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b43249e8-6b87-43ad-8453-8f48faffdcbc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:25.897452 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b43249e8-6b87-43ad-8453-8f48faffdcbc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:25.898231 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b43249e8-6b87-43ad-8453-8f48faffdcbc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:25.898698 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b43249e8-6b87-43ad-8453-8f48faffdcbc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:25.899120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b43249e8-6b87-43ad-8453-8f48faffdcbc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:25.933303 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-32288878-7499-4882-bba8-519ed59dddfd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:25.934050 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-32288878-7499-4882-bba8-519ed59dddfd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:25.941012 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-32288878-7499-4882-bba8-519ed59dddfd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:25.941593 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-32288878-7499-4882-bba8-519ed59dddfd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:25.942129 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-32288878-7499-4882-bba8-519ed59dddfd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:25.942842 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-32288878-7499-4882-bba8-519ed59dddfd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:25.943283 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-32288878-7499-4882-bba8-519ed59dddfd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:25.943815 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-32288878-7499-4882-bba8-519ed59dddfd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:25.968382 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b43249e8-6b87-43ad-8453-8f48faffdcbc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:25.977922 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b43249e8-6b87-43ad-8453-8f48faffdcbc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:25.979491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b43249e8-6b87-43ad-8453-8f48faffdcbc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:25.980616 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b43249e8-6b87-43ad-8453-8f48faffdcbc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1280 microversion: 2.20 time: 0.095788 Aug 05 20:44:25.981227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 28/50] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:25 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1280 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:26.029299 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-32288878-7499-4882-bba8-519ed59dddfd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:26.039563 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-32288878-7499-4882-bba8-519ed59dddfd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1298 microversion: 2.1 time: 0.110456 Aug 05 20:44:26.040063 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 23/51] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:25 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:26.058962 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a62355cc-478a-4a0e-b2b5-807b364ee5ee tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:26.059950 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a62355cc-478a-4a0e-b2b5-807b364ee5ee tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:26.066223 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a62355cc-478a-4a0e-b2b5-807b364ee5ee tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:26.066702 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a62355cc-478a-4a0e-b2b5-807b364ee5ee tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:26.067129 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a62355cc-478a-4a0e-b2b5-807b364ee5ee tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:26.067846 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a62355cc-478a-4a0e-b2b5-807b364ee5ee tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:26.068848 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a62355cc-478a-4a0e-b2b5-807b364ee5ee tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:26.069535 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a62355cc-478a-4a0e-b2b5-807b364ee5ee tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:26.131377 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a62355cc-478a-4a0e-b2b5-807b364ee5ee tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:26.139157 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a62355cc-478a-4a0e-b2b5-807b364ee5ee tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1237 microversion: 2.1 time: 0.084128 Aug 05 20:44:26.139746 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 29/52] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:26 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:26.642141 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ae0c26f1-445f-421a-b1bc-97a0d0c1d564 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:26.642767 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ae0c26f1-445f-421a-b1bc-97a0d0c1d564 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:26.649804 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ae0c26f1-445f-421a-b1bc-97a0d0c1d564 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:26.650298 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ae0c26f1-445f-421a-b1bc-97a0d0c1d564 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:26.650736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ae0c26f1-445f-421a-b1bc-97a0d0c1d564 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:26.651459 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ae0c26f1-445f-421a-b1bc-97a0d0c1d564 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:26.651914 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ae0c26f1-445f-421a-b1bc-97a0d0c1d564 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:26.652342 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ae0c26f1-445f-421a-b1bc-97a0d0c1d564 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:26.719582 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ae0c26f1-445f-421a-b1bc-97a0d0c1d564 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:26.727752 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ae0c26f1-445f-421a-b1bc-97a0d0c1d564 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1289 microversion: 2.1 time: 0.089460 Aug 05 20:44:26.728333 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 24/53] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:26 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:27.004338 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3746ff6d-b628-49ae-a20c-36756d2b1c62 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:27.005251 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3746ff6d-b628-49ae-a20c-36756d2b1c62 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:27.015525 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3746ff6d-b628-49ae-a20c-36756d2b1c62 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:27.016057 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3746ff6d-b628-49ae-a20c-36756d2b1c62 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:27.016489 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3746ff6d-b628-49ae-a20c-36756d2b1c62 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:27.017425 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3746ff6d-b628-49ae-a20c-36756d2b1c62 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:27.017940 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3746ff6d-b628-49ae-a20c-36756d2b1c62 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:27.018391 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3746ff6d-b628-49ae-a20c-36756d2b1c62 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:27.062141 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-20b8630a-7ec5-4eca-8fe5-1e19cf16ac83 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:27.064925 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-20b8630a-7ec5-4eca-8fe5-1e19cf16ac83 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:27.072236 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20b8630a-7ec5-4eca-8fe5-1e19cf16ac83 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:27.074143 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20b8630a-7ec5-4eca-8fe5-1e19cf16ac83 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:27.074604 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20b8630a-7ec5-4eca-8fe5-1e19cf16ac83 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:27.075591 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20b8630a-7ec5-4eca-8fe5-1e19cf16ac83 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:27.076056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20b8630a-7ec5-4eca-8fe5-1e19cf16ac83 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:27.076634 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20b8630a-7ec5-4eca-8fe5-1e19cf16ac83 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:27.273205 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3746ff6d-b628-49ae-a20c-36756d2b1c62 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:27.295324 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-20b8630a-7ec5-4eca-8fe5-1e19cf16ac83 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:27.304719 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3746ff6d-b628-49ae-a20c-36756d2b1c62 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:27.308341 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-20b8630a-7ec5-4eca-8fe5-1e19cf16ac83 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1316 microversion: 2.1 time: 0.251161 Aug 05 20:44:27.318599 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 25/54] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:27 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:44:27.319332 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3746ff6d-b628-49ae-a20c-36756d2b1c62 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:27.319332 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3746ff6d-b628-49ae-a20c-36756d2b1c62 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1344 microversion: 2.20 time: 0.313999 Aug 05 20:44:27.322381 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 30/55] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:26 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1344 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:27.333827 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-44b67d0a-577f-45a4-bf5d-9354b47bd053 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:27.334566 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-44b67d0a-577f-45a4-bf5d-9354b47bd053 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:27.353421 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-44b67d0a-577f-45a4-bf5d-9354b47bd053 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:27.353913 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-44b67d0a-577f-45a4-bf5d-9354b47bd053 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:27.354414 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-44b67d0a-577f-45a4-bf5d-9354b47bd053 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:27.355218 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-44b67d0a-577f-45a4-bf5d-9354b47bd053 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:27.355699 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-44b67d0a-577f-45a4-bf5d-9354b47bd053 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:27.356123 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-44b67d0a-577f-45a4-bf5d-9354b47bd053 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:27.753613 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a18a0076-8ecd-4781-bd8a-021b82767d07 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:27.754507 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a18a0076-8ecd-4781-bd8a-021b82767d07 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:27.769285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a18a0076-8ecd-4781-bd8a-021b82767d07 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:27.769806 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a18a0076-8ecd-4781-bd8a-021b82767d07 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:27.770283 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a18a0076-8ecd-4781-bd8a-021b82767d07 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:27.771224 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a18a0076-8ecd-4781-bd8a-021b82767d07 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:27.771803 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a18a0076-8ecd-4781-bd8a-021b82767d07 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:27.775984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a18a0076-8ecd-4781-bd8a-021b82767d07 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:27.834926 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-44b67d0a-577f-45a4-bf5d-9354b47bd053 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:27.862688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-44b67d0a-577f-45a4-bf5d-9354b47bd053 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1293 microversion: 2.1 time: 0.548930 Aug 05 20:44:27.880939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 26/56] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:27 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1293 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:28.086586 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a18a0076-8ecd-4781-bd8a-021b82767d07 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:28.105946 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a18a0076-8ecd-4781-bd8a-021b82767d07 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1277 microversion: 2.1 time: 0.356515 Aug 05 20:44:28.109429 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 31/57] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:27 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1277 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:28.361576 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fe5e1946-df3c-4d34-b25a-9fa6152a03a3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:28.363791 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fe5e1946-df3c-4d34-b25a-9fa6152a03a3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:28.370517 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d062872d-2c7a-4417-833d-4358f501cbce tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:28.374860 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d062872d-2c7a-4417-833d-4358f501cbce tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:28.388979 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe5e1946-df3c-4d34-b25a-9fa6152a03a3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:28.400097 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe5e1946-df3c-4d34-b25a-9fa6152a03a3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:28.400097 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe5e1946-df3c-4d34-b25a-9fa6152a03a3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:28.400097 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe5e1946-df3c-4d34-b25a-9fa6152a03a3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:28.400097 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe5e1946-df3c-4d34-b25a-9fa6152a03a3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:28.402665 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fe5e1946-df3c-4d34-b25a-9fa6152a03a3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:28.402760 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d062872d-2c7a-4417-833d-4358f501cbce tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:28.403588 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d062872d-2c7a-4417-833d-4358f501cbce tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:28.412750 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d062872d-2c7a-4417-833d-4358f501cbce tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:28.416808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d062872d-2c7a-4417-833d-4358f501cbce tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:28.419290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d062872d-2c7a-4417-833d-4358f501cbce tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:28.421554 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d062872d-2c7a-4417-833d-4358f501cbce tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:29.181884 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d062872d-2c7a-4417-833d-4358f501cbce tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:29.196830 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d062872d-2c7a-4417-833d-4358f501cbce tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1304 microversion: 2.1 time: 0.860343 Aug 05 20:44:29.210343 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 27/58] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:28 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1304 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:44:29.226562 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-6d2cadca-f29c-4195-9c79-8bdd7ca1533d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:29.227228 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-6d2cadca-f29c-4195-9c79-8bdd7ca1533d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:29.257478 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6d2cadca-f29c-4195-9c79-8bdd7ca1533d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:29.259576 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6d2cadca-f29c-4195-9c79-8bdd7ca1533d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:29.262458 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6d2cadca-f29c-4195-9c79-8bdd7ca1533d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:29.264922 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6d2cadca-f29c-4195-9c79-8bdd7ca1533d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:29.265877 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6d2cadca-f29c-4195-9c79-8bdd7ca1533d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:29.266586 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6d2cadca-f29c-4195-9c79-8bdd7ca1533d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:29.292640 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fe5e1946-df3c-4d34-b25a-9fa6152a03a3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:29.314833 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fe5e1946-df3c-4d34-b25a-9fa6152a03a3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:29.331994 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fe5e1946-df3c-4d34-b25a-9fa6152a03a3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:29.344537 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fe5e1946-df3c-4d34-b25a-9fa6152a03a3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1342 microversion: 2.20 time: 0.997939 Aug 05 20:44:29.346056 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 32/59] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:28 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1342 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:29.364046 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-526606a9-b8b6-481a-a4fd-907487ad9e8d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:29.365495 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-526606a9-b8b6-481a-a4fd-907487ad9e8d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:29.388302 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-526606a9-b8b6-481a-a4fd-907487ad9e8d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:29.389681 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-526606a9-b8b6-481a-a4fd-907487ad9e8d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:29.390384 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-526606a9-b8b6-481a-a4fd-907487ad9e8d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:29.392526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-526606a9-b8b6-481a-a4fd-907487ad9e8d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:29.396564 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-526606a9-b8b6-481a-a4fd-907487ad9e8d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:29.398504 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-526606a9-b8b6-481a-a4fd-907487ad9e8d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:29.838622 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-6d2cadca-f29c-4195-9c79-8bdd7ca1533d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:29.870645 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-6d2cadca-f29c-4195-9c79-8bdd7ca1533d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1299 microversion: 2.1 time: 0.667579 Aug 05 20:44:29.871316 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 28/60] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:29 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1299 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:29.972708 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-526606a9-b8b6-481a-a4fd-907487ad9e8d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:29.991459 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-526606a9-b8b6-481a-a4fd-907487ad9e8d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1277 microversion: 2.1 time: 0.638698 Aug 05 20:44:30.009669 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 33/61] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:29 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1277 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:30.215164 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=4 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:30.221219 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-dbf52ff3-d924-4451-b537-744f8b229221 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:30.221995 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-dbf52ff3-d924-4451-b537-744f8b229221 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:30.224536 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:30.242532 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dbf52ff3-d924-4451-b537-744f8b229221 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:30.243455 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dbf52ff3-d924-4451-b537-744f8b229221 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:30.244457 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dbf52ff3-d924-4451-b537-744f8b229221 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:30.245567 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dbf52ff3-d924-4451-b537-744f8b229221 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:30.246363 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dbf52ff3-d924-4451-b537-744f8b229221 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:30.247168 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dbf52ff3-d924-4451-b537-744f8b229221 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:30.305693 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=16 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:30.374975 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-29f81e97-94d2-4bf7-a6bb-0dae6cacfc46 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:30.376568 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-29f81e97-94d2-4bf7-a6bb-0dae6cacfc46 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:30.387474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29f81e97-94d2-4bf7-a6bb-0dae6cacfc46 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:30.390031 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29f81e97-94d2-4bf7-a6bb-0dae6cacfc46 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:30.400293 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29f81e97-94d2-4bf7-a6bb-0dae6cacfc46 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:30.401638 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29f81e97-94d2-4bf7-a6bb-0dae6cacfc46 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:30.402398 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29f81e97-94d2-4bf7-a6bb-0dae6cacfc46 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:30.403145 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29f81e97-94d2-4bf7-a6bb-0dae6cacfc46 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:30.404100 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=4 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:30.626899 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-29f81e97-94d2-4bf7-a6bb-0dae6cacfc46 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:30.667060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-29f81e97-94d2-4bf7-a6bb-0dae6cacfc46 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:30.675804 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-29f81e97-94d2-4bf7-a6bb-0dae6cacfc46 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:30.681249 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-29f81e97-94d2-4bf7-a6bb-0dae6cacfc46 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1342 microversion: 2.20 time: 0.310441 Aug 05 20:44:30.682641 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 34/62] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:30 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1342 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:44:30.852915 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-dbf52ff3-d924-4451-b537-744f8b229221 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:30.865999 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-dbf52ff3-d924-4451-b537-744f8b229221 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.651165 Aug 05 20:44:30.866839 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 29/63] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:30 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:30.904498 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b6380607-ef92-4ea2-8616-009fb23b5a0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:30.905617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b6380607-ef92-4ea2-8616-009fb23b5a0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:30.951014 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6380607-ef92-4ea2-8616-009fb23b5a0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:30.955551 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6380607-ef92-4ea2-8616-009fb23b5a0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:30.960094 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6380607-ef92-4ea2-8616-009fb23b5a0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:30.960922 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6380607-ef92-4ea2-8616-009fb23b5a0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:30.965702 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6380607-ef92-4ea2-8616-009fb23b5a0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:30.966230 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6380607-ef92-4ea2-8616-009fb23b5a0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:31.017994 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-05315142-523d-46b1-aadb-e21762b64113 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:31.019900 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-05315142-523d-46b1-aadb-e21762b64113 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:31.036047 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-05315142-523d-46b1-aadb-e21762b64113 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:31.039427 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-05315142-523d-46b1-aadb-e21762b64113 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:31.040606 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-05315142-523d-46b1-aadb-e21762b64113 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:31.045419 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-05315142-523d-46b1-aadb-e21762b64113 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:31.047116 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-05315142-523d-46b1-aadb-e21762b64113 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:31.049034 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-05315142-523d-46b1-aadb-e21762b64113 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:31.292551 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b6380607-ef92-4ea2-8616-009fb23b5a0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:31.366417 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b6380607-ef92-4ea2-8616-009fb23b5a0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1299 microversion: 2.1 time: 0.474253 Aug 05 20:44:31.380182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 35/64] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:30 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1299 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:31.628905 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=24 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:31.742285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-8abeb2bf-5ff8-4197-945a-697f9ae761a9 req-deaabe59-0ce4-4742-950b-0cb4d29fbff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c086ce48-8e37-432f-ab19-e87c53936473", "tag": "f6caac16-d258-4d36-8bff-99bcad0b9419"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:31.771781 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-8abeb2bf-5ff8-4197-945a-697f9ae761a9 req-deaabe59-0ce4-4742-950b-0cb4d29fbff7 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:31.772288 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-8abeb2bf-5ff8-4197-945a-697f9ae761a9 req-deaabe59-0ce4-4742-950b-0cb4d29fbff7 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:31.772785 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-8abeb2bf-5ff8-4197-945a-697f9ae761a9 req-deaabe59-0ce4-4742-950b-0cb4d29fbff7 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:31.830984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-8abeb2bf-5ff8-4197-945a-697f9ae761a9 req-deaabe59-0ce4-4742-950b-0cb4d29fbff7 service nova] Creating event network-changed:f6caac16-d258-4d36-8bff-99bcad0b9419 for instance c086ce48-8e37-432f-ab19-e87c53936473 on hv-cinder-85220 Aug 05 20:44:31.831892 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-8abeb2bf-5ff8-4197-945a-697f9ae761a9 req-deaabe59-0ce4-4742-950b-0cb4d29fbff7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 20:44:31.832643 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-8abeb2bf-5ff8-4197-945a-697f9ae761a9 req-deaabe59-0ce4-4742-950b-0cb4d29fbff7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 20:44:31.834597 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36b481cd-9fbf-4dd3-964c-14b40cab4aa7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:31.835227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36b481cd-9fbf-4dd3-964c-14b40cab4aa7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:31.835691 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36b481cd-9fbf-4dd3-964c-14b40cab4aa7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:31.836870 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36b481cd-9fbf-4dd3-964c-14b40cab4aa7 None None] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:31.837322 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36b481cd-9fbf-4dd3-964c-14b40cab4aa7 None None] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:31.837796 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36b481cd-9fbf-4dd3-964c-14b40cab4aa7 None None] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:31.879229 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.compute.rpcapi [None req-36b481cd-9fbf-4dd3-964c-14b40cab4aa7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 20:44:31.880247 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36b481cd-9fbf-4dd3-964c-14b40cab4aa7 None None] Releasing lock "compute-rpcapi-router" {{(pid=124432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 20:44:31.903456 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-36b481cd-9fbf-4dd3-964c-14b40cab4aa7 None None] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281766 Aug 05 20:44:31.904470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 36/65] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:44:31.912717 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c98a947e-54fc-4d0e-9415-f95ec3de84ff tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:31.913930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c98a947e-54fc-4d0e-9415-f95ec3de84ff tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:31.921839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:31.924773 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c98a947e-54fc-4d0e-9415-f95ec3de84ff tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:31.925875 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c98a947e-54fc-4d0e-9415-f95ec3de84ff tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:31.926557 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c98a947e-54fc-4d0e-9415-f95ec3de84ff tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:31.936789 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c98a947e-54fc-4d0e-9415-f95ec3de84ff tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:31.937620 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c98a947e-54fc-4d0e-9415-f95ec3de84ff tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:31.938194 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c98a947e-54fc-4d0e-9415-f95ec3de84ff tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:31.989581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:32.158075 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c98a947e-54fc-4d0e-9415-f95ec3de84ff tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:32.168500 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c98a947e-54fc-4d0e-9415-f95ec3de84ff tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:32.170338 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c98a947e-54fc-4d0e-9415-f95ec3de84ff tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:32.177352 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c98a947e-54fc-4d0e-9415-f95ec3de84ff tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1342 microversion: 2.20 time: 0.271114 Aug 05 20:44:32.198043 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 37/66] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:31 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1342 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:32.204611 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-679cd42e-5629-4d05-9648-87dedd5a6344 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:32.214013 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-05315142-523d-46b1-aadb-e21762b64113 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:32.218432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=100 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:32.221419 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-679cd42e-5629-4d05-9648-87dedd5a6344 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:32.227323 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-05315142-523d-46b1-aadb-e21762b64113 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 1.212078 Aug 05 20:44:32.228152 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 30/67] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:31 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:32.241158 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-679cd42e-5629-4d05-9648-87dedd5a6344 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:32.242498 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-679cd42e-5629-4d05-9648-87dedd5a6344 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:32.243538 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-679cd42e-5629-4d05-9648-87dedd5a6344 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:32.245461 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-679cd42e-5629-4d05-9648-87dedd5a6344 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:32.246544 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-679cd42e-5629-4d05-9648-87dedd5a6344 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:32.247677 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-679cd42e-5629-4d05-9648-87dedd5a6344 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:32.405377 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f83c6da7-ebe8-452e-80eb-3622e5dfbf83 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:32.407957 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f83c6da7-ebe8-452e-80eb-3622e5dfbf83 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:32.429246 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f83c6da7-ebe8-452e-80eb-3622e5dfbf83 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:32.429757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f83c6da7-ebe8-452e-80eb-3622e5dfbf83 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:32.430193 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f83c6da7-ebe8-452e-80eb-3622e5dfbf83 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:32.435604 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f83c6da7-ebe8-452e-80eb-3622e5dfbf83 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:32.436374 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f83c6da7-ebe8-452e-80eb-3622e5dfbf83 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:32.437012 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f83c6da7-ebe8-452e-80eb-3622e5dfbf83 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:32.707319 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-679cd42e-5629-4d05-9648-87dedd5a6344 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:32.726684 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-679cd42e-5629-4d05-9648-87dedd5a6344 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.527024 Aug 05 20:44:32.727352 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 38/68] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:32 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:32.833441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f83c6da7-ebe8-452e-80eb-3622e5dfbf83 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:32.842874 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f83c6da7-ebe8-452e-80eb-3622e5dfbf83 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.444617 Aug 05 20:44:32.843502 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 31/69] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:32 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:44:33.205432 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1cc9338d-e028-4226-8036-9cb5b7ba9300 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:33.205956 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1cc9338d-e028-4226-8036-9cb5b7ba9300 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:33.212629 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1cc9338d-e028-4226-8036-9cb5b7ba9300 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:33.213112 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1cc9338d-e028-4226-8036-9cb5b7ba9300 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:33.213545 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1cc9338d-e028-4226-8036-9cb5b7ba9300 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:33.214245 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1cc9338d-e028-4226-8036-9cb5b7ba9300 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:33.214687 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1cc9338d-e028-4226-8036-9cb5b7ba9300 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:33.215118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1cc9338d-e028-4226-8036-9cb5b7ba9300 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:33.251067 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0b961d26-3778-4ac5-b38e-7ac3e6b31974 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:33.251849 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0b961d26-3778-4ac5-b38e-7ac3e6b31974 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:33.258610 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b961d26-3778-4ac5-b38e-7ac3e6b31974 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:33.259444 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b961d26-3778-4ac5-b38e-7ac3e6b31974 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:33.260049 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b961d26-3778-4ac5-b38e-7ac3e6b31974 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:33.261002 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b961d26-3778-4ac5-b38e-7ac3e6b31974 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:33.261557 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b961d26-3778-4ac5-b38e-7ac3e6b31974 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:33.262074 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b961d26-3778-4ac5-b38e-7ac3e6b31974 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:33.460163 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1cc9338d-e028-4226-8036-9cb5b7ba9300 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:33.469351 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1cc9338d-e028-4226-8036-9cb5b7ba9300 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:33.471547 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1cc9338d-e028-4226-8036-9cb5b7ba9300 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:33.473178 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1cc9338d-e028-4226-8036-9cb5b7ba9300 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.271894 Aug 05 20:44:33.473870 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 39/70] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:33 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:33.489272 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0b961d26-3778-4ac5-b38e-7ac3e6b31974 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:33.497371 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0b961d26-3778-4ac5-b38e-7ac3e6b31974 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.251169 Aug 05 20:44:33.498121 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 32/71] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:33 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:44:33.747988 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f2ef7a03-90ed-4e85-a169-a0ebdabfa186 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:33.748738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f2ef7a03-90ed-4e85-a169-a0ebdabfa186 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:33.754846 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f2ef7a03-90ed-4e85-a169-a0ebdabfa186 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:33.755333 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f2ef7a03-90ed-4e85-a169-a0ebdabfa186 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:33.755908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f2ef7a03-90ed-4e85-a169-a0ebdabfa186 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:33.756720 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f2ef7a03-90ed-4e85-a169-a0ebdabfa186 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:33.757196 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f2ef7a03-90ed-4e85-a169-a0ebdabfa186 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:33.757622 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f2ef7a03-90ed-4e85-a169-a0ebdabfa186 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:33.863884 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f39e80b4-88b7-427c-9abb-7d1f7da896eb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:33.864423 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f39e80b4-88b7-427c-9abb-7d1f7da896eb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:33.870838 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f39e80b4-88b7-427c-9abb-7d1f7da896eb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:33.871290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f39e80b4-88b7-427c-9abb-7d1f7da896eb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:33.871822 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f39e80b4-88b7-427c-9abb-7d1f7da896eb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:33.872621 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f39e80b4-88b7-427c-9abb-7d1f7da896eb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:33.873067 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f39e80b4-88b7-427c-9abb-7d1f7da896eb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:33.873486 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f39e80b4-88b7-427c-9abb-7d1f7da896eb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:33.899987 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f2ef7a03-90ed-4e85-a169-a0ebdabfa186 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:33.908317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f2ef7a03-90ed-4e85-a169-a0ebdabfa186 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.164172 Aug 05 20:44:33.909059 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 40/72] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:33 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:34.015589 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f39e80b4-88b7-427c-9abb-7d1f7da896eb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:34.023344 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f39e80b4-88b7-427c-9abb-7d1f7da896eb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.163475 Aug 05 20:44:34.023959 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 33/73] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:33 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:44:34.497809 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9a83ef6b-4c22-49ed-90a1-90e5472b8f00 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:34.498652 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9a83ef6b-4c22-49ed-90a1-90e5472b8f00 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:34.510703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9a83ef6b-4c22-49ed-90a1-90e5472b8f00 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:34.513174 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9a83ef6b-4c22-49ed-90a1-90e5472b8f00 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:34.519720 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0e605d17-1f8d-46d8-bc24-c44d2b28ae79 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:34.532128 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9a83ef6b-4c22-49ed-90a1-90e5472b8f00 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:34.532128 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9a83ef6b-4c22-49ed-90a1-90e5472b8f00 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:34.532128 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9a83ef6b-4c22-49ed-90a1-90e5472b8f00 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:34.535203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9a83ef6b-4c22-49ed-90a1-90e5472b8f00 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:34.535951 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0e605d17-1f8d-46d8-bc24-c44d2b28ae79 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:34.549064 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0e605d17-1f8d-46d8-bc24-c44d2b28ae79 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:34.549959 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0e605d17-1f8d-46d8-bc24-c44d2b28ae79 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:34.550739 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0e605d17-1f8d-46d8-bc24-c44d2b28ae79 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:34.551873 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0e605d17-1f8d-46d8-bc24-c44d2b28ae79 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:34.552531 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0e605d17-1f8d-46d8-bc24-c44d2b28ae79 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:34.554006 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0e605d17-1f8d-46d8-bc24-c44d2b28ae79 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:35.274044 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0e605d17-1f8d-46d8-bc24-c44d2b28ae79 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:35.282705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0e605d17-1f8d-46d8-bc24-c44d2b28ae79 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.767830 Aug 05 20:44:35.300309 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9a83ef6b-4c22-49ed-90a1-90e5472b8f00 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:35.304843 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 34/74] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:34 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:35.310143 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9bec9c8f-3372-43a6-b592-4aef3f5be24f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:35.310956 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9bec9c8f-3372-43a6-b592-4aef3f5be24f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:35.317455 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9bec9c8f-3372-43a6-b592-4aef3f5be24f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:35.318110 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9bec9c8f-3372-43a6-b592-4aef3f5be24f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:35.318754 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9bec9c8f-3372-43a6-b592-4aef3f5be24f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:35.319039 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9a83ef6b-4c22-49ed-90a1-90e5472b8f00 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:35.319892 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9bec9c8f-3372-43a6-b592-4aef3f5be24f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:35.320491 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9bec9c8f-3372-43a6-b592-4aef3f5be24f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:35.320825 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9a83ef6b-4c22-49ed-90a1-90e5472b8f00 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:35.321225 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9bec9c8f-3372-43a6-b592-4aef3f5be24f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:35.322154 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9a83ef6b-4c22-49ed-90a1-90e5472b8f00 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.829495 Aug 05 20:44:35.322717 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 41/75] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:34 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:35.332368 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e65abb63-7ec3-463f-a7a6-c18e0f3ccb3e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:35.333312 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e65abb63-7ec3-463f-a7a6-c18e0f3ccb3e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:35.340762 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e65abb63-7ec3-463f-a7a6-c18e0f3ccb3e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:35.341391 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e65abb63-7ec3-463f-a7a6-c18e0f3ccb3e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:35.342005 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e65abb63-7ec3-463f-a7a6-c18e0f3ccb3e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:35.342707 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e65abb63-7ec3-463f-a7a6-c18e0f3ccb3e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:35.343173 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e65abb63-7ec3-463f-a7a6-c18e0f3ccb3e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:35.343630 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e65abb63-7ec3-463f-a7a6-c18e0f3ccb3e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:35.522591 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-9bec9c8f-3372-43a6-b592-4aef3f5be24f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:35.530944 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9bec9c8f-3372-43a6-b592-4aef3f5be24f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.224799 Aug 05 20:44:35.536545 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 35/76] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:35 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:35.546086 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e65abb63-7ec3-463f-a7a6-c18e0f3ccb3e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:35.556076 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e65abb63-7ec3-463f-a7a6-c18e0f3ccb3e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.232109 Aug 05 20:44:35.557244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 42/77] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:35 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:36.315304 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-37be072e-03a6-41f1-80a1-c74d1b9bc42f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:36.316402 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-37be072e-03a6-41f1-80a1-c74d1b9bc42f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:36.324027 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-37be072e-03a6-41f1-80a1-c74d1b9bc42f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:36.324502 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-37be072e-03a6-41f1-80a1-c74d1b9bc42f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:36.324927 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-37be072e-03a6-41f1-80a1-c74d1b9bc42f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:36.325610 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-37be072e-03a6-41f1-80a1-c74d1b9bc42f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:36.326410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-37be072e-03a6-41f1-80a1-c74d1b9bc42f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:36.326530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-37be072e-03a6-41f1-80a1-c74d1b9bc42f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:36.345498 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4f49890c-01f4-412c-9e02-1fcae20e6efd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:36.346134 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4f49890c-01f4-412c-9e02-1fcae20e6efd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:36.352846 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4f49890c-01f4-412c-9e02-1fcae20e6efd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:36.353347 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4f49890c-01f4-412c-9e02-1fcae20e6efd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:36.353804 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4f49890c-01f4-412c-9e02-1fcae20e6efd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:36.354503 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4f49890c-01f4-412c-9e02-1fcae20e6efd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:36.354960 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4f49890c-01f4-412c-9e02-1fcae20e6efd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:36.355386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4f49890c-01f4-412c-9e02-1fcae20e6efd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:36.554322 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-37be072e-03a6-41f1-80a1-c74d1b9bc42f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:36.561773 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-37be072e-03a6-41f1-80a1-c74d1b9bc42f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.252769 Aug 05 20:44:36.576367 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 36/78] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:36 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:36.586054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4f49890c-01f4-412c-9e02-1fcae20e6efd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:36.588250 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a463ef46-d803-4a42-8b2f-47a702c61026 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:36.589109 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a463ef46-d803-4a42-8b2f-47a702c61026 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:36.595608 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a463ef46-d803-4a42-8b2f-47a702c61026 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:36.596335 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a463ef46-d803-4a42-8b2f-47a702c61026 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:36.596894 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a463ef46-d803-4a42-8b2f-47a702c61026 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:36.597587 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4f49890c-01f4-412c-9e02-1fcae20e6efd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:36.597940 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a463ef46-d803-4a42-8b2f-47a702c61026 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:36.598528 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a463ef46-d803-4a42-8b2f-47a702c61026 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:36.599074 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a463ef46-d803-4a42-8b2f-47a702c61026 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:36.601762 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4f49890c-01f4-412c-9e02-1fcae20e6efd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:36.604440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4f49890c-01f4-412c-9e02-1fcae20e6efd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.262963 Aug 05 20:44:36.616612 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 43/79] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:36 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:36.623014 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fc4eba8d-b163-49dc-8336-49acd6e39904 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:36.624089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fc4eba8d-b163-49dc-8336-49acd6e39904 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:36.630707 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fc4eba8d-b163-49dc-8336-49acd6e39904 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:36.631211 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fc4eba8d-b163-49dc-8336-49acd6e39904 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:36.631938 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fc4eba8d-b163-49dc-8336-49acd6e39904 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:36.632365 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fc4eba8d-b163-49dc-8336-49acd6e39904 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:36.632852 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fc4eba8d-b163-49dc-8336-49acd6e39904 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:36.633278 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fc4eba8d-b163-49dc-8336-49acd6e39904 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:36.821337 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a463ef46-d803-4a42-8b2f-47a702c61026 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:36.828471 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fc4eba8d-b163-49dc-8336-49acd6e39904 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:36.836552 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fc4eba8d-b163-49dc-8336-49acd6e39904 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.218548 Aug 05 20:44:36.837127 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 44/80] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:36 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:36.837251 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a463ef46-d803-4a42-8b2f-47a702c61026 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.259301 Aug 05 20:44:36.837891 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 37/81] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:36 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:37.586505 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-880ca70c-982e-4dd9-aa61-2730c361fd1c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:37.587849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-880ca70c-982e-4dd9-aa61-2730c361fd1c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:37.594429 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-880ca70c-982e-4dd9-aa61-2730c361fd1c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:37.595746 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-880ca70c-982e-4dd9-aa61-2730c361fd1c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:37.596603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-880ca70c-982e-4dd9-aa61-2730c361fd1c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:37.597074 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-880ca70c-982e-4dd9-aa61-2730c361fd1c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:37.597515 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-880ca70c-982e-4dd9-aa61-2730c361fd1c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:37.598120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-880ca70c-982e-4dd9-aa61-2730c361fd1c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:37.628802 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a149e4a2-448f-4a2d-a98b-6ab5d33081cc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:37.629413 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a149e4a2-448f-4a2d-a98b-6ab5d33081cc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:37.637007 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a149e4a2-448f-4a2d-a98b-6ab5d33081cc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:37.637506 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a149e4a2-448f-4a2d-a98b-6ab5d33081cc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:37.637931 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a149e4a2-448f-4a2d-a98b-6ab5d33081cc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:37.638638 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a149e4a2-448f-4a2d-a98b-6ab5d33081cc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:37.639075 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a149e4a2-448f-4a2d-a98b-6ab5d33081cc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:37.639518 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a149e4a2-448f-4a2d-a98b-6ab5d33081cc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:37.814251 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-880ca70c-982e-4dd9-aa61-2730c361fd1c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:37.825359 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-880ca70c-982e-4dd9-aa61-2730c361fd1c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.242786 Aug 05 20:44:37.835457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 45/82] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:37 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:37.843420 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a149e4a2-448f-4a2d-a98b-6ab5d33081cc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:37.852342 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a149e4a2-448f-4a2d-a98b-6ab5d33081cc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:37.853873 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a149e4a2-448f-4a2d-a98b-6ab5d33081cc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:37.854988 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a149e4a2-448f-4a2d-a98b-6ab5d33081cc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.230144 Aug 05 20:44:37.855560 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 38/83] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:37 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:37.858618 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d3f3544f-806c-40da-9e3c-ad05e4744aab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:37.859345 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d3f3544f-806c-40da-9e3c-ad05e4744aab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:37.862142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f17fd999-6e96-40a1-a3cc-bceec805f71c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:37.863332 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f17fd999-6e96-40a1-a3cc-bceec805f71c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:37.870987 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f17fd999-6e96-40a1-a3cc-bceec805f71c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:37.871823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f17fd999-6e96-40a1-a3cc-bceec805f71c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:37.872394 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f17fd999-6e96-40a1-a3cc-bceec805f71c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:37.873377 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f17fd999-6e96-40a1-a3cc-bceec805f71c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:37.874151 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f17fd999-6e96-40a1-a3cc-bceec805f71c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:37.874278 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3f3544f-806c-40da-9e3c-ad05e4744aab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:37.874834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3f3544f-806c-40da-9e3c-ad05e4744aab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:37.875123 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f17fd999-6e96-40a1-a3cc-bceec805f71c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:37.875473 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3f3544f-806c-40da-9e3c-ad05e4744aab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:37.876283 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3f3544f-806c-40da-9e3c-ad05e4744aab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:37.876982 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3f3544f-806c-40da-9e3c-ad05e4744aab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:37.877593 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3f3544f-806c-40da-9e3c-ad05e4744aab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:38.126256 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d3f3544f-806c-40da-9e3c-ad05e4744aab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:38.144493 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d3f3544f-806c-40da-9e3c-ad05e4744aab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.290435 Aug 05 20:44:38.145399 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 46/84] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:37 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:44:38.198670 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f17fd999-6e96-40a1-a3cc-bceec805f71c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:38.228801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f17fd999-6e96-40a1-a3cc-bceec805f71c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.371984 Aug 05 20:44:38.229658 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 39/85] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:37 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:38.854159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a99c2831-69a7-4323-94b3-bb88b4f4ca8c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:38.854813 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a99c2831-69a7-4323-94b3-bb88b4f4ca8c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:38.861234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a99c2831-69a7-4323-94b3-bb88b4f4ca8c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:38.861716 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a99c2831-69a7-4323-94b3-bb88b4f4ca8c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:38.862141 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a99c2831-69a7-4323-94b3-bb88b4f4ca8c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:38.862828 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a99c2831-69a7-4323-94b3-bb88b4f4ca8c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:38.863271 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a99c2831-69a7-4323-94b3-bb88b4f4ca8c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:38.863790 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a99c2831-69a7-4323-94b3-bb88b4f4ca8c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:38.881852 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3fd96de5-5961-4e6e-a3d4-8992683a3c03 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:38.882497 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3fd96de5-5961-4e6e-a3d4-8992683a3c03 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:38.902675 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3fd96de5-5961-4e6e-a3d4-8992683a3c03 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:38.903263 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3fd96de5-5961-4e6e-a3d4-8992683a3c03 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:38.905786 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3fd96de5-5961-4e6e-a3d4-8992683a3c03 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:38.906917 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3fd96de5-5961-4e6e-a3d4-8992683a3c03 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:38.907428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3fd96de5-5961-4e6e-a3d4-8992683a3c03 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:38.907866 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3fd96de5-5961-4e6e-a3d4-8992683a3c03 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:39.244438 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3fd96de5-5961-4e6e-a3d4-8992683a3c03 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:39.245909 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a99c2831-69a7-4323-94b3-bb88b4f4ca8c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:39.253847 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a99c2831-69a7-4323-94b3-bb88b4f4ca8c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.411246 Aug 05 20:44:39.255219 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3fd96de5-5961-4e6e-a3d4-8992683a3c03 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:39.256927 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3fd96de5-5961-4e6e-a3d4-8992683a3c03 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:39.259888 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 47/86] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:38 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:39.264600 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3fd96de5-5961-4e6e-a3d4-8992683a3c03 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.388535 Aug 05 20:44:39.265170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 40/87] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:38 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:39.279304 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0a7a54c0-f20c-4e3f-b3bb-ddc10d348b6f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:39.279304 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0a7a54c0-f20c-4e3f-b3bb-ddc10d348b6f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:39.286817 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a7a54c0-f20c-4e3f-b3bb-ddc10d348b6f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:39.287308 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-87b7ffdf-eb48-44e6-9f81-d75057f4f2f6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:39.287722 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a7a54c0-f20c-4e3f-b3bb-ddc10d348b6f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:39.287964 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-87b7ffdf-eb48-44e6-9f81-d75057f4f2f6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:39.288472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a7a54c0-f20c-4e3f-b3bb-ddc10d348b6f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:39.289326 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a7a54c0-f20c-4e3f-b3bb-ddc10d348b6f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:39.289924 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a7a54c0-f20c-4e3f-b3bb-ddc10d348b6f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:39.290697 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a7a54c0-f20c-4e3f-b3bb-ddc10d348b6f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:39.300610 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-87b7ffdf-eb48-44e6-9f81-d75057f4f2f6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:39.301104 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-87b7ffdf-eb48-44e6-9f81-d75057f4f2f6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:39.301545 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-87b7ffdf-eb48-44e6-9f81-d75057f4f2f6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:39.302255 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-87b7ffdf-eb48-44e6-9f81-d75057f4f2f6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:39.302744 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-87b7ffdf-eb48-44e6-9f81-d75057f4f2f6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:39.303181 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-87b7ffdf-eb48-44e6-9f81-d75057f4f2f6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:39.538383 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0a7a54c0-f20c-4e3f-b3bb-ddc10d348b6f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:39.557655 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0a7a54c0-f20c-4e3f-b3bb-ddc10d348b6f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.296263 Aug 05 20:44:39.561801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 48/88] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:39 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:39.580107 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-87b7ffdf-eb48-44e6-9f81-d75057f4f2f6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:39.584097 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-87b7ffdf-eb48-44e6-9f81-d75057f4f2f6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.303666 Aug 05 20:44:39.597889 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 41/89] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:39 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:40.283552 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ebcc7922-ed7d-4280-95c9-9c81eed73852 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:40.284189 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ebcc7922-ed7d-4280-95c9-9c81eed73852 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:40.288200 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ca25d407-9869-4d44-a3f2-79f33514aa32 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:40.288812 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ca25d407-9869-4d44-a3f2-79f33514aa32 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:40.295809 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ca25d407-9869-4d44-a3f2-79f33514aa32 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:40.296548 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ca25d407-9869-4d44-a3f2-79f33514aa32 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:40.297138 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ca25d407-9869-4d44-a3f2-79f33514aa32 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:40.298048 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ca25d407-9869-4d44-a3f2-79f33514aa32 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:40.298661 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ca25d407-9869-4d44-a3f2-79f33514aa32 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:40.299230 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ca25d407-9869-4d44-a3f2-79f33514aa32 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:40.306687 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebcc7922-ed7d-4280-95c9-9c81eed73852 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:40.307525 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebcc7922-ed7d-4280-95c9-9c81eed73852 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:40.307949 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebcc7922-ed7d-4280-95c9-9c81eed73852 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:40.308704 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebcc7922-ed7d-4280-95c9-9c81eed73852 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:40.309163 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebcc7922-ed7d-4280-95c9-9c81eed73852 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:40.309589 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebcc7922-ed7d-4280-95c9-9c81eed73852 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:40.596617 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ca25d407-9869-4d44-a3f2-79f33514aa32 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:40.606448 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ebcc7922-ed7d-4280-95c9-9c81eed73852 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:40.615733 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ca25d407-9869-4d44-a3f2-79f33514aa32 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:40.617304 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ca25d407-9869-4d44-a3f2-79f33514aa32 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:40.617870 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ebcc7922-ed7d-4280-95c9-9c81eed73852 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.341014 Aug 05 20:44:40.618447 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ca25d407-9869-4d44-a3f2-79f33514aa32 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.335335 Aug 05 20:44:40.618585 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 49/90] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:40 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:40.638133 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 42/91] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:40 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:44:40.638375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1869b891-18f1-45cb-b4aa-a39bdd47915e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:40.638479 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-aeefdf63-6720-403e-ab71-473f62a55c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:40.638479 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-aeefdf63-6720-403e-ab71-473f62a55c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:40.639765 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1869b891-18f1-45cb-b4aa-a39bdd47915e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:40.645746 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aeefdf63-6720-403e-ab71-473f62a55c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:40.646867 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aeefdf63-6720-403e-ab71-473f62a55c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:40.647504 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aeefdf63-6720-403e-ab71-473f62a55c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:40.651043 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aeefdf63-6720-403e-ab71-473f62a55c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:40.651839 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aeefdf63-6720-403e-ab71-473f62a55c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:40.652332 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1869b891-18f1-45cb-b4aa-a39bdd47915e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:40.652827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1869b891-18f1-45cb-b4aa-a39bdd47915e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:40.653274 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aeefdf63-6720-403e-ab71-473f62a55c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:40.659047 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1869b891-18f1-45cb-b4aa-a39bdd47915e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:40.659933 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1869b891-18f1-45cb-b4aa-a39bdd47915e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:40.660368 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1869b891-18f1-45cb-b4aa-a39bdd47915e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:40.660789 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1869b891-18f1-45cb-b4aa-a39bdd47915e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:40.898126 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-aeefdf63-6720-403e-ab71-473f62a55c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:40.903077 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1869b891-18f1-45cb-b4aa-a39bdd47915e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:40.905981 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-aeefdf63-6720-403e-ab71-473f62a55c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.277793 Aug 05 20:44:40.906934 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 43/92] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:40 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:40.922967 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1869b891-18f1-45cb-b4aa-a39bdd47915e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.303368 Aug 05 20:44:40.923854 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 50/93] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:40 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:41.641918 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-2bdd2c14-9239-4995-a0da-c360fad9acbb tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:41.643908 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-2bdd2c14-9239-4995-a0da-c360fad9acbb tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:41.647799 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-07c6544f-6523-4b72-8f2f-1ed4fd1b3b84 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:41.651404 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-07c6544f-6523-4b72-8f2f-1ed4fd1b3b84 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:41.653542 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2bdd2c14-9239-4995-a0da-c360fad9acbb tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:41.654514 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2bdd2c14-9239-4995-a0da-c360fad9acbb tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:41.655199 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2bdd2c14-9239-4995-a0da-c360fad9acbb tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:41.656417 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2bdd2c14-9239-4995-a0da-c360fad9acbb tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:41.657605 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2bdd2c14-9239-4995-a0da-c360fad9acbb tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:41.658294 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2bdd2c14-9239-4995-a0da-c360fad9acbb tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:41.667745 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07c6544f-6523-4b72-8f2f-1ed4fd1b3b84 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:41.668389 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07c6544f-6523-4b72-8f2f-1ed4fd1b3b84 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:41.669104 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07c6544f-6523-4b72-8f2f-1ed4fd1b3b84 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:41.670048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07c6544f-6523-4b72-8f2f-1ed4fd1b3b84 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:41.670739 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07c6544f-6523-4b72-8f2f-1ed4fd1b3b84 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:41.671596 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07c6544f-6523-4b72-8f2f-1ed4fd1b3b84 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:41.866725 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:42.521101 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-07c6544f-6523-4b72-8f2f-1ed4fd1b3b84 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:42.533982 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-07c6544f-6523-4b72-8f2f-1ed4fd1b3b84 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:42.536987 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-07c6544f-6523-4b72-8f2f-1ed4fd1b3b84 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:42.539136 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-07c6544f-6523-4b72-8f2f-1ed4fd1b3b84 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.897652 Aug 05 20:44:42.540919 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 51/94] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:41 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:42.547797 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9c12ee4f-cb3e-47c9-9ff8-0ff2aff583ad tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:42.548683 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9c12ee4f-cb3e-47c9-9ff8-0ff2aff583ad tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:42.556269 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c12ee4f-cb3e-47c9-9ff8-0ff2aff583ad tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:42.556753 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c12ee4f-cb3e-47c9-9ff8-0ff2aff583ad tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:42.557211 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c12ee4f-cb3e-47c9-9ff8-0ff2aff583ad tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:42.557961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c12ee4f-cb3e-47c9-9ff8-0ff2aff583ad tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:42.558408 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c12ee4f-cb3e-47c9-9ff8-0ff2aff583ad tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:42.558822 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c12ee4f-cb3e-47c9-9ff8-0ff2aff583ad tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:42.600863 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2bdd2c14-9239-4995-a0da-c360fad9acbb tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:42.609030 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-2bdd2c14-9239-4995-a0da-c360fad9acbb tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.973385 Aug 05 20:44:42.620008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 44/95] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:41 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:42.624821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4bb292bb-5553-42ee-b2b4-125d9b2b32e7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:42.625679 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4bb292bb-5553-42ee-b2b4-125d9b2b32e7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:42.632160 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4bb292bb-5553-42ee-b2b4-125d9b2b32e7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:42.632909 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4bb292bb-5553-42ee-b2b4-125d9b2b32e7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:42.633534 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4bb292bb-5553-42ee-b2b4-125d9b2b32e7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:42.634431 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4bb292bb-5553-42ee-b2b4-125d9b2b32e7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:42.635065 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4bb292bb-5553-42ee-b2b4-125d9b2b32e7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:42.635714 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4bb292bb-5553-42ee-b2b4-125d9b2b32e7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:43.127114 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9c12ee4f-cb3e-47c9-9ff8-0ff2aff583ad tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:43.137805 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9c12ee4f-cb3e-47c9-9ff8-0ff2aff583ad tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.594563 Aug 05 20:44:43.138636 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 52/96] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:42 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:43.168407 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4bb292bb-5553-42ee-b2b4-125d9b2b32e7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:43.180958 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4bb292bb-5553-42ee-b2b4-125d9b2b32e7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.557997 Aug 05 20:44:43.182023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 45/97] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:42 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:43.563296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-aefd47af-049e-4a48-a4a1-f90c73f3e79a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:43.564312 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-aefd47af-049e-4a48-a4a1-f90c73f3e79a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:43.574021 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aefd47af-049e-4a48-a4a1-f90c73f3e79a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:43.585311 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aefd47af-049e-4a48-a4a1-f90c73f3e79a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:43.585766 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aefd47af-049e-4a48-a4a1-f90c73f3e79a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:43.586514 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aefd47af-049e-4a48-a4a1-f90c73f3e79a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:43.586976 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aefd47af-049e-4a48-a4a1-f90c73f3e79a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:43.587419 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aefd47af-049e-4a48-a4a1-f90c73f3e79a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:43.643305 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-64d59d61-578e-45d3-bf1f-39536b6fe334 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:43.643963 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-64d59d61-578e-45d3-bf1f-39536b6fe334 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:43.659690 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-64d59d61-578e-45d3-bf1f-39536b6fe334 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:43.662068 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-64d59d61-578e-45d3-bf1f-39536b6fe334 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:43.663880 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-64d59d61-578e-45d3-bf1f-39536b6fe334 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:43.665569 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-64d59d61-578e-45d3-bf1f-39536b6fe334 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:43.671067 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-64d59d61-578e-45d3-bf1f-39536b6fe334 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:43.671754 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-64d59d61-578e-45d3-bf1f-39536b6fe334 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:44.197211 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-aefd47af-049e-4a48-a4a1-f90c73f3e79a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:44.203429 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:44.212789 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-aefd47af-049e-4a48-a4a1-f90c73f3e79a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:44.216062 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-aefd47af-049e-4a48-a4a1-f90c73f3e79a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:44.220406 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-aefd47af-049e-4a48-a4a1-f90c73f3e79a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.661079 Aug 05 20:44:44.221202 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 53/98] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:43 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:44.252659 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2a0049a9-3fc2-4a61-872a-78c6e22fb7a3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:44.253552 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2a0049a9-3fc2-4a61-872a-78c6e22fb7a3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:44.266260 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a0049a9-3fc2-4a61-872a-78c6e22fb7a3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:44.266744 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a0049a9-3fc2-4a61-872a-78c6e22fb7a3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:44.267863 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a0049a9-3fc2-4a61-872a-78c6e22fb7a3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:44.272629 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a0049a9-3fc2-4a61-872a-78c6e22fb7a3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:44.273289 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a0049a9-3fc2-4a61-872a-78c6e22fb7a3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:44.273721 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a0049a9-3fc2-4a61-872a-78c6e22fb7a3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:44.681782 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-64d59d61-578e-45d3-bf1f-39536b6fe334 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:44.693182 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-64d59d61-578e-45d3-bf1f-39536b6fe334 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 1.055805 Aug 05 20:44:44.706675 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 46/99] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:43 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:44:44.723375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-63a88e2a-1426-4376-8bd9-f36a35bcfe5d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:44.727922 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-63a88e2a-1426-4376-8bd9-f36a35bcfe5d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:44.740552 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-63a88e2a-1426-4376-8bd9-f36a35bcfe5d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:44.741131 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-63a88e2a-1426-4376-8bd9-f36a35bcfe5d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:44.741785 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-63a88e2a-1426-4376-8bd9-f36a35bcfe5d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:44.742794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-63a88e2a-1426-4376-8bd9-f36a35bcfe5d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:44.743502 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-63a88e2a-1426-4376-8bd9-f36a35bcfe5d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:44.744315 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-63a88e2a-1426-4376-8bd9-f36a35bcfe5d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:44.764289 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=100 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:45.195709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2a0049a9-3fc2-4a61-872a-78c6e22fb7a3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:45.208953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2a0049a9-3fc2-4a61-872a-78c6e22fb7a3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.960279 Aug 05 20:44:45.209719 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 54/100] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:44 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:45.402055 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-63a88e2a-1426-4376-8bd9-f36a35bcfe5d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:45.415702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-63a88e2a-1426-4376-8bd9-f36a35bcfe5d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.716560 Aug 05 20:44:45.441587 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 47/101] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:44 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:45.449631 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f3f0357f-d81f-4b3d-8118-b065caaade98 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:45.450532 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f3f0357f-d81f-4b3d-8118-b065caaade98 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:45.460369 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f3f0357f-d81f-4b3d-8118-b065caaade98 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:45.461364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f3f0357f-d81f-4b3d-8118-b065caaade98 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:45.462134 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f3f0357f-d81f-4b3d-8118-b065caaade98 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:45.463069 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f3f0357f-d81f-4b3d-8118-b065caaade98 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:45.466137 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f3f0357f-d81f-4b3d-8118-b065caaade98 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:45.467115 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f3f0357f-d81f-4b3d-8118-b065caaade98 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:45.493013 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-f446e725-3544-4bcc-aff0-c13fe69d7089 req-fedad9d1-85fe-47c9-a0f2-65af0ce4042e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20537f07-e2b8-4c88-8757-58c0b37570d2", "tag": "a196cd1a-7fd3-4c91-8b4f-d500d0c2740a"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:45.516890 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-f446e725-3544-4bcc-aff0-c13fe69d7089 req-fedad9d1-85fe-47c9-a0f2-65af0ce4042e service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:45.517651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-f446e725-3544-4bcc-aff0-c13fe69d7089 req-fedad9d1-85fe-47c9-a0f2-65af0ce4042e service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:45.518249 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-f446e725-3544-4bcc-aff0-c13fe69d7089 req-fedad9d1-85fe-47c9-a0f2-65af0ce4042e service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:45.540855 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-f446e725-3544-4bcc-aff0-c13fe69d7089 req-fedad9d1-85fe-47c9-a0f2-65af0ce4042e service nova] Creating event network-changed:a196cd1a-7fd3-4c91-8b4f-d500d0c2740a for instance 20537f07-e2b8-4c88-8757-58c0b37570d2 on hv-cinder-85220 Aug 05 20:44:45.560003 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-f446e725-3544-4bcc-aff0-c13fe69d7089 req-fedad9d1-85fe-47c9-a0f2-65af0ce4042e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.339939 Aug 05 20:44:45.562231 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 55/102] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:44:45.714984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3176a3fa-daee-4584-b448-f0683916d9bc tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:45.715852 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3176a3fa-daee-4584-b448-f0683916d9bc tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:45.725405 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3176a3fa-daee-4584-b448-f0683916d9bc tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:45.728940 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3176a3fa-daee-4584-b448-f0683916d9bc tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:45.729488 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3176a3fa-daee-4584-b448-f0683916d9bc tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:45.732677 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3176a3fa-daee-4584-b448-f0683916d9bc tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:45.733262 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3176a3fa-daee-4584-b448-f0683916d9bc tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:45.733804 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3176a3fa-daee-4584-b448-f0683916d9bc tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:46.111608 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f3f0357f-d81f-4b3d-8118-b065caaade98 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:46.121343 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f3f0357f-d81f-4b3d-8118-b065caaade98 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:46.123178 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f3f0357f-d81f-4b3d-8118-b065caaade98 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:46.124545 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f3f0357f-d81f-4b3d-8118-b065caaade98 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.681576 Aug 05 20:44:46.125335 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 48/103] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:45 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:46.211098 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3176a3fa-daee-4584-b448-f0683916d9bc tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:46.219124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3176a3fa-daee-4584-b448-f0683916d9bc tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.508304 Aug 05 20:44:46.232788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 56/104] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:45 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:46.234345 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3be7d9ec-8399-45fe-9e4b-6d2af2f90ab5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:46.235875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3be7d9ec-8399-45fe-9e4b-6d2af2f90ab5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:46.244514 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3be7d9ec-8399-45fe-9e4b-6d2af2f90ab5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:46.245198 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3be7d9ec-8399-45fe-9e4b-6d2af2f90ab5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:46.245941 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3be7d9ec-8399-45fe-9e4b-6d2af2f90ab5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:46.247416 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3be7d9ec-8399-45fe-9e4b-6d2af2f90ab5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:46.247951 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3be7d9ec-8399-45fe-9e4b-6d2af2f90ab5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:46.248533 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3be7d9ec-8399-45fe-9e4b-6d2af2f90ab5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:46.408863 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3be7d9ec-8399-45fe-9e4b-6d2af2f90ab5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:46.418703 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3be7d9ec-8399-45fe-9e4b-6d2af2f90ab5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.191070 Aug 05 20:44:46.420057 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 49/105] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:46 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:46.441886 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-457d17e5-059f-4e2a-93fc-e1843d75d213 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:46.442785 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-457d17e5-059f-4e2a-93fc-e1843d75d213 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:46.455772 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-457d17e5-059f-4e2a-93fc-e1843d75d213 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:46.456455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-457d17e5-059f-4e2a-93fc-e1843d75d213 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:46.458801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-457d17e5-059f-4e2a-93fc-e1843d75d213 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:46.461557 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-457d17e5-059f-4e2a-93fc-e1843d75d213 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:46.462215 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-457d17e5-059f-4e2a-93fc-e1843d75d213 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:46.462641 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-457d17e5-059f-4e2a-93fc-e1843d75d213 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:46.630819 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-457d17e5-059f-4e2a-93fc-e1843d75d213 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:46.639725 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-457d17e5-059f-4e2a-93fc-e1843d75d213 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.201833 Aug 05 20:44:46.640299 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 57/106] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:46 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:47.151032 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3f015204-b966-4583-af25-4d32cd9c2b59 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:47.152193 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3f015204-b966-4583-af25-4d32cd9c2b59 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:47.177818 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3f015204-b966-4583-af25-4d32cd9c2b59 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:47.178484 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3f015204-b966-4583-af25-4d32cd9c2b59 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:47.178921 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3f015204-b966-4583-af25-4d32cd9c2b59 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:47.182811 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3f015204-b966-4583-af25-4d32cd9c2b59 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:47.183478 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3f015204-b966-4583-af25-4d32cd9c2b59 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:47.186714 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3f015204-b966-4583-af25-4d32cd9c2b59 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:47.254775 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7c5c4bda-5c8b-4a84-9126-1480b402843f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:47.263014 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7c5c4bda-5c8b-4a84-9126-1480b402843f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:47.273626 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7c5c4bda-5c8b-4a84-9126-1480b402843f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:47.274499 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7c5c4bda-5c8b-4a84-9126-1480b402843f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:47.275119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7c5c4bda-5c8b-4a84-9126-1480b402843f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:47.276318 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7c5c4bda-5c8b-4a84-9126-1480b402843f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:47.276952 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7c5c4bda-5c8b-4a84-9126-1480b402843f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:47.277551 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7c5c4bda-5c8b-4a84-9126-1480b402843f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:47.428222 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3f015204-b966-4583-af25-4d32cd9c2b59 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:47.437796 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3f015204-b966-4583-af25-4d32cd9c2b59 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:47.439531 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3f015204-b966-4583-af25-4d32cd9c2b59 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:47.446303 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3f015204-b966-4583-af25-4d32cd9c2b59 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.296170 Aug 05 20:44:47.448338 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 50/107] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:47 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:47.461843 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-eea14f7c-8e2c-420f-9fb1-c82a79319fe6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:47.464559 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-eea14f7c-8e2c-420f-9fb1-c82a79319fe6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:47.480383 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eea14f7c-8e2c-420f-9fb1-c82a79319fe6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:47.481044 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eea14f7c-8e2c-420f-9fb1-c82a79319fe6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:47.482281 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eea14f7c-8e2c-420f-9fb1-c82a79319fe6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:47.483930 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eea14f7c-8e2c-420f-9fb1-c82a79319fe6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:47.484529 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eea14f7c-8e2c-420f-9fb1-c82a79319fe6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:47.485103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eea14f7c-8e2c-420f-9fb1-c82a79319fe6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:47.790346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7c5c4bda-5c8b-4a84-9126-1480b402843f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:47.797998 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7c5c4bda-5c8b-4a84-9126-1480b402843f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.561341 Aug 05 20:44:47.799128 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 58/108] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:47 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:44:47.804301 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8c20e228-c84c-4adc-83de-c22cba19a8ca tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:47.805187 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8c20e228-c84c-4adc-83de-c22cba19a8ca tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:47.816393 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c20e228-c84c-4adc-83de-c22cba19a8ca tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:47.817130 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c20e228-c84c-4adc-83de-c22cba19a8ca tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:47.817627 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c20e228-c84c-4adc-83de-c22cba19a8ca tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:47.825745 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c20e228-c84c-4adc-83de-c22cba19a8ca tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:47.826312 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c20e228-c84c-4adc-83de-c22cba19a8ca tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:47.826791 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c20e228-c84c-4adc-83de-c22cba19a8ca tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:48.098900 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-eea14f7c-8e2c-420f-9fb1-c82a79319fe6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:48.111277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-eea14f7c-8e2c-420f-9fb1-c82a79319fe6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.657865 Aug 05 20:44:48.119788 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 51/109] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:47 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:48.126149 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-3d93cad2-87d7-4481-84ef-94ef89f96f39 req-c4b165d9-3572-44a8-91fc-9b19e4f7465b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d0d279-aa7f-4377-a9de-27b205539317", "tag": "a4ff702b-a590-46c1-a7b7-3cf69b3604dc"}, {"name": "network-changed", "server_uuid": "39afe8dc-01f2-4947-b48c-ac9664fb46cd", "tag": "34a70542-760a-48dc-85b0-7ef5bbff6348"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:48.140354 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-3d93cad2-87d7-4481-84ef-94ef89f96f39 req-c4b165d9-3572-44a8-91fc-9b19e4f7465b service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:48.140843 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-3d93cad2-87d7-4481-84ef-94ef89f96f39 req-c4b165d9-3572-44a8-91fc-9b19e4f7465b service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:48.141278 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-3d93cad2-87d7-4481-84ef-94ef89f96f39 req-c4b165d9-3572-44a8-91fc-9b19e4f7465b service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:48.165549 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-3d93cad2-87d7-4481-84ef-94ef89f96f39 req-c4b165d9-3572-44a8-91fc-9b19e4f7465b service nova] Creating event network-changed:a4ff702b-a590-46c1-a7b7-3cf69b3604dc for instance 34d0d279-aa7f-4377-a9de-27b205539317 on hv-cinder-85220 Aug 05 20:44:48.166674 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8c20e228-c84c-4adc-83de-c22cba19a8ca tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:48.167036 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-3d93cad2-87d7-4481-84ef-94ef89f96f39 req-c4b165d9-3572-44a8-91fc-9b19e4f7465b service nova] Creating event network-changed:34a70542-760a-48dc-85b0-7ef5bbff6348 for instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd on hv-cinder-85220 Aug 05 20:44:48.167790 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-3d93cad2-87d7-4481-84ef-94ef89f96f39 req-c4b165d9-3572-44a8-91fc-9b19e4f7465b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 20:44:48.168355 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-3d93cad2-87d7-4481-84ef-94ef89f96f39 req-c4b165d9-3572-44a8-91fc-9b19e4f7465b service nova] Acquired lock "compute-rpcapi-router" {{(pid=124431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 20:44:48.169557 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6c0f592f-dd8f-445b-a824-4c66564e7b6f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:48.170184 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6c0f592f-dd8f-445b-a824-4c66564e7b6f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:48.170757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6c0f592f-dd8f-445b-a824-4c66564e7b6f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:48.171704 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6c0f592f-dd8f-445b-a824-4c66564e7b6f None None] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:48.172394 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6c0f592f-dd8f-445b-a824-4c66564e7b6f None None] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:48.172995 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6c0f592f-dd8f-445b-a824-4c66564e7b6f None None] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:48.178426 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8c20e228-c84c-4adc-83de-c22cba19a8ca tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.377765 Aug 05 20:44:48.183513 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.compute.rpcapi [None req-6c0f592f-dd8f-445b-a824-4c66564e7b6f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 20:44:48.184409 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6c0f592f-dd8f-445b-a824-4c66564e7b6f None None] Releasing lock "compute-rpcapi-router" {{(pid=124431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 20:44:48.192186 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 59/110] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:47 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:48.203139 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-6c0f592f-dd8f-445b-a824-4c66564e7b6f None None] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.082045 Aug 05 20:44:48.206848 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 52/111] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:44:48.469895 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-519b6297-5ee0-448f-aa3a-a3833b9dce53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:48.470679 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-519b6297-5ee0-448f-aa3a-a3833b9dce53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:48.480974 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-519b6297-5ee0-448f-aa3a-a3833b9dce53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:48.481471 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-519b6297-5ee0-448f-aa3a-a3833b9dce53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:48.481892 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-519b6297-5ee0-448f-aa3a-a3833b9dce53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:48.484238 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-519b6297-5ee0-448f-aa3a-a3833b9dce53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:48.494810 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-519b6297-5ee0-448f-aa3a-a3833b9dce53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:48.495487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-519b6297-5ee0-448f-aa3a-a3833b9dce53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:48.820762 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-bdb31eee-c600-4d3b-84ff-ef58a11d5b2d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:48.821767 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-bdb31eee-c600-4d3b-84ff-ef58a11d5b2d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:48.832714 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bdb31eee-c600-4d3b-84ff-ef58a11d5b2d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:48.834867 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bdb31eee-c600-4d3b-84ff-ef58a11d5b2d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:48.835578 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bdb31eee-c600-4d3b-84ff-ef58a11d5b2d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:48.836712 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bdb31eee-c600-4d3b-84ff-ef58a11d5b2d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:48.837441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bdb31eee-c600-4d3b-84ff-ef58a11d5b2d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:48.838071 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bdb31eee-c600-4d3b-84ff-ef58a11d5b2d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:48.918466 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-519b6297-5ee0-448f-aa3a-a3833b9dce53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:48.944217 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-519b6297-5ee0-448f-aa3a-a3833b9dce53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:48.950210 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-519b6297-5ee0-448f-aa3a-a3833b9dce53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:48.952442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-519b6297-5ee0-448f-aa3a-a3833b9dce53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.486531 Aug 05 20:44:48.953808 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 60/112] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:48 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:49.125312 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-770841b9-03d2-4ee3-a7dc-6b28217a1435 req-8bab6879-19f3-4030-8406-da8cf07e2631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c086ce48-8e37-432f-ab19-e87c53936473", "name": "network-vif-plugged", "status": "completed", "tag": "f6caac16-d258-4d36-8bff-99bcad0b9419"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:49.128999 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-bdb31eee-c600-4d3b-84ff-ef58a11d5b2d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:49.139022 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-bdb31eee-c600-4d3b-84ff-ef58a11d5b2d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.322937 Aug 05 20:44:49.139638 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 53/113] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:48 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:49.145294 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-770841b9-03d2-4ee3-a7dc-6b28217a1435 req-8bab6879-19f3-4030-8406-da8cf07e2631 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:49.145820 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-770841b9-03d2-4ee3-a7dc-6b28217a1435 req-8bab6879-19f3-4030-8406-da8cf07e2631 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:49.146247 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-770841b9-03d2-4ee3-a7dc-6b28217a1435 req-8bab6879-19f3-4030-8406-da8cf07e2631 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:49.151813 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-97fce708-044c-4d26-9163-e91938998ea4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:49.152420 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-97fce708-044c-4d26-9163-e91938998ea4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:49.164219 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-97fce708-044c-4d26-9163-e91938998ea4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:49.164674 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-97fce708-044c-4d26-9163-e91938998ea4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:49.165101 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-97fce708-044c-4d26-9163-e91938998ea4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:49.165821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-97fce708-044c-4d26-9163-e91938998ea4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:49.166436 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-97fce708-044c-4d26-9163-e91938998ea4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:49.166669 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-97fce708-044c-4d26-9163-e91938998ea4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:49.168946 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-770841b9-03d2-4ee3-a7dc-6b28217a1435 req-8bab6879-19f3-4030-8406-da8cf07e2631 service nova] Creating event network-vif-plugged:f6caac16-d258-4d36-8bff-99bcad0b9419 for instance c086ce48-8e37-432f-ab19-e87c53936473 on hv-cinder-85220 Aug 05 20:44:49.176670 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-770841b9-03d2-4ee3-a7dc-6b28217a1435 req-8bab6879-19f3-4030-8406-da8cf07e2631 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132955 Aug 05 20:44:49.179013 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 61/114] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:44:49.201959 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-64063aee-8961-4b51-ae68-f977464264da tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:49.202769 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-64063aee-8961-4b51-ae68-f977464264da tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:49.209526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-64063aee-8961-4b51-ae68-f977464264da tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:49.210094 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-64063aee-8961-4b51-ae68-f977464264da tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:49.210651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-64063aee-8961-4b51-ae68-f977464264da tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:49.211602 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-64063aee-8961-4b51-ae68-f977464264da tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:49.212208 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-64063aee-8961-4b51-ae68-f977464264da tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:49.212783 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-64063aee-8961-4b51-ae68-f977464264da tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:49.359942 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-97fce708-044c-4d26-9163-e91938998ea4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:49.368591 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-97fce708-044c-4d26-9163-e91938998ea4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.227087 Aug 05 20:44:49.369170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 54/115] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:49 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:49.386984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-64063aee-8961-4b51-ae68-f977464264da tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:49.396350 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-64063aee-8961-4b51-ae68-f977464264da tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.198528 Aug 05 20:44:49.397037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 62/116] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:49 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:44:49.978705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-eec04bf2-8c0f-497c-b1fd-97db8c2dc137 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:49.979368 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-eec04bf2-8c0f-497c-b1fd-97db8c2dc137 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:49.986069 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eec04bf2-8c0f-497c-b1fd-97db8c2dc137 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:49.986556 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eec04bf2-8c0f-497c-b1fd-97db8c2dc137 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:49.986996 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eec04bf2-8c0f-497c-b1fd-97db8c2dc137 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:49.987723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eec04bf2-8c0f-497c-b1fd-97db8c2dc137 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:49.988179 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eec04bf2-8c0f-497c-b1fd-97db8c2dc137 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:49.988601 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eec04bf2-8c0f-497c-b1fd-97db8c2dc137 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:50.118622 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-eec04bf2-8c0f-497c-b1fd-97db8c2dc137 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:50.127195 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-eec04bf2-8c0f-497c-b1fd-97db8c2dc137 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:50.128754 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-eec04bf2-8c0f-497c-b1fd-97db8c2dc137 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:50.129870 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-eec04bf2-8c0f-497c-b1fd-97db8c2dc137 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.155586 Aug 05 20:44:50.130685 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 55/117] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:49 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:50.161441 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f460d7da-9b25-4d6a-95d2-8bde16b49901 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:50.162158 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f460d7da-9b25-4d6a-95d2-8bde16b49901 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:50.168956 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f460d7da-9b25-4d6a-95d2-8bde16b49901 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:50.169526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f460d7da-9b25-4d6a-95d2-8bde16b49901 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:50.169885 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f460d7da-9b25-4d6a-95d2-8bde16b49901 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:50.170583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f460d7da-9b25-4d6a-95d2-8bde16b49901 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:50.171106 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f460d7da-9b25-4d6a-95d2-8bde16b49901 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:50.171570 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f460d7da-9b25-4d6a-95d2-8bde16b49901 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:50.313195 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f460d7da-9b25-4d6a-95d2-8bde16b49901 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:50.320887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f460d7da-9b25-4d6a-95d2-8bde16b49901 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.163355 Aug 05 20:44:50.321423 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 63/118] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:50 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:50.390076 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-6987f035-96d4-4f3c-a36f-45c2a66219c3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:50.390681 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-6987f035-96d4-4f3c-a36f-45c2a66219c3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:50.397372 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6987f035-96d4-4f3c-a36f-45c2a66219c3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:50.397848 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6987f035-96d4-4f3c-a36f-45c2a66219c3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:50.398287 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6987f035-96d4-4f3c-a36f-45c2a66219c3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:50.398967 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6987f035-96d4-4f3c-a36f-45c2a66219c3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:50.399408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6987f035-96d4-4f3c-a36f-45c2a66219c3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:50.399848 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6987f035-96d4-4f3c-a36f-45c2a66219c3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:50.417930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-11875e25-55be-4d38-afb5-b96ff8b68879 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:50.418621 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-11875e25-55be-4d38-afb5-b96ff8b68879 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:50.425080 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-11875e25-55be-4d38-afb5-b96ff8b68879 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:50.425583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-11875e25-55be-4d38-afb5-b96ff8b68879 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:50.426001 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-11875e25-55be-4d38-afb5-b96ff8b68879 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:50.426901 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-11875e25-55be-4d38-afb5-b96ff8b68879 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:50.427391 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-11875e25-55be-4d38-afb5-b96ff8b68879 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:50.427829 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-11875e25-55be-4d38-afb5-b96ff8b68879 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:50.600871 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-6987f035-96d4-4f3c-a36f-45c2a66219c3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:50.604464 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-11875e25-55be-4d38-afb5-b96ff8b68879 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:50.608640 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-6987f035-96d4-4f3c-a36f-45c2a66219c3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.222600 Aug 05 20:44:50.609204 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 56/119] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:50 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:50.612458 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-11875e25-55be-4d38-afb5-b96ff8b68879 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.198425 Aug 05 20:44:50.613099 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 64/120] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:50 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:51.152721 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a0cdd125-6665-4fc1-b801-ddcf5639a3ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:51.153363 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a0cdd125-6665-4fc1-b801-ddcf5639a3ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:51.159885 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a0cdd125-6665-4fc1-b801-ddcf5639a3ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:51.160364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a0cdd125-6665-4fc1-b801-ddcf5639a3ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:51.160795 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a0cdd125-6665-4fc1-b801-ddcf5639a3ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:51.161475 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a0cdd125-6665-4fc1-b801-ddcf5639a3ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:51.162204 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a0cdd125-6665-4fc1-b801-ddcf5639a3ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:51.162637 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a0cdd125-6665-4fc1-b801-ddcf5639a3ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:51.297240 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a0cdd125-6665-4fc1-b801-ddcf5639a3ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:51.309123 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a0cdd125-6665-4fc1-b801-ddcf5639a3ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:51.311415 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a0cdd125-6665-4fc1-b801-ddcf5639a3ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:51.313162 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a0cdd125-6665-4fc1-b801-ddcf5639a3ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.164121 Aug 05 20:44:51.313910 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 57/121] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:51 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:51.341518 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-dc74bf33-f454-4a0c-85a8-f76f1124d88b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:51.342234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-dc74bf33-f454-4a0c-85a8-f76f1124d88b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:51.348413 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dc74bf33-f454-4a0c-85a8-f76f1124d88b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:51.349102 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dc74bf33-f454-4a0c-85a8-f76f1124d88b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:51.349457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dc74bf33-f454-4a0c-85a8-f76f1124d88b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:51.350169 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dc74bf33-f454-4a0c-85a8-f76f1124d88b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:51.350623 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dc74bf33-f454-4a0c-85a8-f76f1124d88b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:51.351030 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dc74bf33-f454-4a0c-85a8-f76f1124d88b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:51.629124 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1310c216-8571-4663-a30b-be2b3d08c339 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:51.629730 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-1310c216-8571-4663-a30b-be2b3d08c339 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:51.636447 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1310c216-8571-4663-a30b-be2b3d08c339 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:51.636925 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1310c216-8571-4663-a30b-be2b3d08c339 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:51.637367 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1310c216-8571-4663-a30b-be2b3d08c339 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:51.638033 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1310c216-8571-4663-a30b-be2b3d08c339 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:51.638473 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1310c216-8571-4663-a30b-be2b3d08c339 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:51.638882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1310c216-8571-4663-a30b-be2b3d08c339 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:51.776391 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-dc74bf33-f454-4a0c-85a8-f76f1124d88b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:51.784755 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-dc74bf33-f454-4a0c-85a8-f76f1124d88b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.447087 Aug 05 20:44:51.786555 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 65/122] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:51 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:51.803908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1b1ea5b1-6450-4ee9-a4f9-6b974e03bbf6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:51.805221 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1b1ea5b1-6450-4ee9-a4f9-6b974e03bbf6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:51.811545 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b1ea5b1-6450-4ee9-a4f9-6b974e03bbf6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:51.812027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b1ea5b1-6450-4ee9-a4f9-6b974e03bbf6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:51.812449 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b1ea5b1-6450-4ee9-a4f9-6b974e03bbf6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:51.813117 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b1ea5b1-6450-4ee9-a4f9-6b974e03bbf6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:51.813560 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b1ea5b1-6450-4ee9-a4f9-6b974e03bbf6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:51.813972 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b1ea5b1-6450-4ee9-a4f9-6b974e03bbf6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:52.089620 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-1310c216-8571-4663-a30b-be2b3d08c339 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:52.098410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-1310c216-8571-4663-a30b-be2b3d08c339 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.473070 Aug 05 20:44:52.098900 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 58/123] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:51 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:44:52.336494 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8be0f82b-8638-42c9-b135-b334cbf7a742 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:52.337116 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8be0f82b-8638-42c9-b135-b334cbf7a742 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:52.344034 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8be0f82b-8638-42c9-b135-b334cbf7a742 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:52.344734 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8be0f82b-8638-42c9-b135-b334cbf7a742 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:52.345317 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8be0f82b-8638-42c9-b135-b334cbf7a742 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:52.346179 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8be0f82b-8638-42c9-b135-b334cbf7a742 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:52.346636 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8be0f82b-8638-42c9-b135-b334cbf7a742 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:52.347057 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8be0f82b-8638-42c9-b135-b334cbf7a742 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:52.512405 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1b1ea5b1-6450-4ee9-a4f9-6b974e03bbf6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:52.521119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1b1ea5b1-6450-4ee9-a4f9-6b974e03bbf6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.731472 Aug 05 20:44:52.522042 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 66/124] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:51 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:52.711000 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8be0f82b-8638-42c9-b135-b334cbf7a742 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:52.724078 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8be0f82b-8638-42c9-b135-b334cbf7a742 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:52.726082 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8be0f82b-8638-42c9-b135-b334cbf7a742 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:52.727330 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8be0f82b-8638-42c9-b135-b334cbf7a742 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.394938 Aug 05 20:44:52.727954 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 59/125] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:52 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:44:52.806185 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-584058b9-9c85-4609-aa8b-4eb76a76cf20 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:52.806804 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-584058b9-9c85-4609-aa8b-4eb76a76cf20 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:52.812734 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-584058b9-9c85-4609-aa8b-4eb76a76cf20 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:52.813230 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-584058b9-9c85-4609-aa8b-4eb76a76cf20 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:52.813665 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-584058b9-9c85-4609-aa8b-4eb76a76cf20 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:52.814376 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-584058b9-9c85-4609-aa8b-4eb76a76cf20 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:52.814833 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-584058b9-9c85-4609-aa8b-4eb76a76cf20 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:52.815256 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-584058b9-9c85-4609-aa8b-4eb76a76cf20 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:53.056565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-584058b9-9c85-4609-aa8b-4eb76a76cf20 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:53.078076 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-584058b9-9c85-4609-aa8b-4eb76a76cf20 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.275807 Aug 05 20:44:53.085935 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 67/126] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:52 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:53.118310 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8167148e-2d72-4d6b-9fd6-7a90ab242243 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:53.119512 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8167148e-2d72-4d6b-9fd6-7a90ab242243 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:53.127843 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8167148e-2d72-4d6b-9fd6-7a90ab242243 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:53.128309 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8167148e-2d72-4d6b-9fd6-7a90ab242243 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:53.128895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8167148e-2d72-4d6b-9fd6-7a90ab242243 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:53.129796 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8167148e-2d72-4d6b-9fd6-7a90ab242243 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:53.130527 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8167148e-2d72-4d6b-9fd6-7a90ab242243 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:53.131088 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8167148e-2d72-4d6b-9fd6-7a90ab242243 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:53.336292 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8167148e-2d72-4d6b-9fd6-7a90ab242243 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:53.344680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8167148e-2d72-4d6b-9fd6-7a90ab242243 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.230252 Aug 05 20:44:53.345417 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 60/127] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:53 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:53.544110 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e9126560-e6d9-4d97-b7d1-0c5bd20a75f2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:53.546741 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e9126560-e6d9-4d97-b7d1-0c5bd20a75f2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:53.557231 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9126560-e6d9-4d97-b7d1-0c5bd20a75f2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:53.565085 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9126560-e6d9-4d97-b7d1-0c5bd20a75f2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:53.565858 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9126560-e6d9-4d97-b7d1-0c5bd20a75f2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:53.566932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9126560-e6d9-4d97-b7d1-0c5bd20a75f2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:53.567621 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9126560-e6d9-4d97-b7d1-0c5bd20a75f2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:53.568530 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9126560-e6d9-4d97-b7d1-0c5bd20a75f2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:53.770765 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-2129de1f-a765-413b-92dc-6343406e91c0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:53.771286 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-2129de1f-a765-413b-92dc-6343406e91c0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:53.784129 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2129de1f-a765-413b-92dc-6343406e91c0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:53.784620 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2129de1f-a765-413b-92dc-6343406e91c0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:53.785115 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2129de1f-a765-413b-92dc-6343406e91c0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:53.790833 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2129de1f-a765-413b-92dc-6343406e91c0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:53.791395 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2129de1f-a765-413b-92dc-6343406e91c0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:53.791898 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2129de1f-a765-413b-92dc-6343406e91c0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:53.930233 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e9126560-e6d9-4d97-b7d1-0c5bd20a75f2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:53.946683 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e9126560-e6d9-4d97-b7d1-0c5bd20a75f2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.405349 Aug 05 20:44:53.951191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 68/128] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:53 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:54.101667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f7ed451c-5736-44e9-9758-ef7eb42a787e tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:54.102290 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f7ed451c-5736-44e9-9758-ef7eb42a787e tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:54.113087 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f7ed451c-5736-44e9-9758-ef7eb42a787e tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:54.115016 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f7ed451c-5736-44e9-9758-ef7eb42a787e tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:54.115487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f7ed451c-5736-44e9-9758-ef7eb42a787e tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:54.118690 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f7ed451c-5736-44e9-9758-ef7eb42a787e tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:54.120551 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f7ed451c-5736-44e9-9758-ef7eb42a787e tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:54.121234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f7ed451c-5736-44e9-9758-ef7eb42a787e tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:54.299123 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2129de1f-a765-413b-92dc-6343406e91c0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:54.316057 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2129de1f-a765-413b-92dc-6343406e91c0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:54.318352 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2129de1f-a765-413b-92dc-6343406e91c0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:54.319548 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-2129de1f-a765-413b-92dc-6343406e91c0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.568749 Aug 05 20:44:54.323453 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 61/129] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:53 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:54.346167 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-68f878b9-daa3-4e30-9c31-4f23741af60e req-0ce9c3e6-2909-4ffa-8a55-ba596d372178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20537f07-e2b8-4c88-8757-58c0b37570d2", "name": "network-vif-plugged", "status": "completed", "tag": "a196cd1a-7fd3-4c91-8b4f-d500d0c2740a"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:54.370774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-68f878b9-daa3-4e30-9c31-4f23741af60e req-0ce9c3e6-2909-4ffa-8a55-ba596d372178 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:54.371794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-68f878b9-daa3-4e30-9c31-4f23741af60e req-0ce9c3e6-2909-4ffa-8a55-ba596d372178 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:54.374195 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-68f878b9-daa3-4e30-9c31-4f23741af60e req-0ce9c3e6-2909-4ffa-8a55-ba596d372178 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:54.391390 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-68f878b9-daa3-4e30-9c31-4f23741af60e req-0ce9c3e6-2909-4ffa-8a55-ba596d372178 service nova] Creating event network-vif-plugged:a196cd1a-7fd3-4c91-8b4f-d500d0c2740a for instance 20537f07-e2b8-4c88-8757-58c0b37570d2 on hv-cinder-85220 Aug 05 20:44:54.398930 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-68f878b9-daa3-4e30-9c31-4f23741af60e req-0ce9c3e6-2909-4ffa-8a55-ba596d372178 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073114 Aug 05 20:44:54.400299 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 62/130] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:44:54.407057 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-bc7673df-bd11-40ac-bfa7-ac4cbc33793b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:54.408649 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-bc7673df-bd11-40ac-bfa7-ac4cbc33793b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:54.419395 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bc7673df-bd11-40ac-bfa7-ac4cbc33793b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:54.420317 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bc7673df-bd11-40ac-bfa7-ac4cbc33793b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:54.433298 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bc7673df-bd11-40ac-bfa7-ac4cbc33793b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:54.434631 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bc7673df-bd11-40ac-bfa7-ac4cbc33793b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:54.438299 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bc7673df-bd11-40ac-bfa7-ac4cbc33793b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:54.438964 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bc7673df-bd11-40ac-bfa7-ac4cbc33793b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:54.443018 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f7ed451c-5736-44e9-9758-ef7eb42a787e tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:54.455670 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f7ed451c-5736-44e9-9758-ef7eb42a787e tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.359209 Aug 05 20:44:54.458656 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 69/131] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:54 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:44:54.697413 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-bc7673df-bd11-40ac-bfa7-ac4cbc33793b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:54.709319 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-bc7673df-bd11-40ac-bfa7-ac4cbc33793b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1371 microversion: 2.1 time: 0.306993 Aug 05 20:44:54.709899 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 63/132] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:54 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:54.973226 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cbaf483c-ae1e-4b6a-9cb9-82b2fbd03970 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:54.974214 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cbaf483c-ae1e-4b6a-9cb9-82b2fbd03970 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:54.992838 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cbaf483c-ae1e-4b6a-9cb9-82b2fbd03970 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:54.993352 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cbaf483c-ae1e-4b6a-9cb9-82b2fbd03970 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:54.993794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cbaf483c-ae1e-4b6a-9cb9-82b2fbd03970 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:54.998916 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cbaf483c-ae1e-4b6a-9cb9-82b2fbd03970 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:54.999802 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cbaf483c-ae1e-4b6a-9cb9-82b2fbd03970 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:55.002601 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cbaf483c-ae1e-4b6a-9cb9-82b2fbd03970 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:55.296646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cbaf483c-ae1e-4b6a-9cb9-82b2fbd03970 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:55.316000 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cbaf483c-ae1e-4b6a-9cb9-82b2fbd03970 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.339655 Aug 05 20:44:55.316879 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 70/133] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:54 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:55.352125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-07e3c6b6-fbcd-41ab-b752-b35c17199c54 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:55.352738 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-07e3c6b6-fbcd-41ab-b752-b35c17199c54 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:55.366627 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-07e3c6b6-fbcd-41ab-b752-b35c17199c54 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:55.367187 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-07e3c6b6-fbcd-41ab-b752-b35c17199c54 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:55.367586 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-07e3c6b6-fbcd-41ab-b752-b35c17199c54 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:55.370752 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-07e3c6b6-fbcd-41ab-b752-b35c17199c54 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:55.371223 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-07e3c6b6-fbcd-41ab-b752-b35c17199c54 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:55.374683 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-07e3c6b6-fbcd-41ab-b752-b35c17199c54 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:55.481809 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b201aa13-2bc8-47c0-8c5d-e92c747d1765 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:55.482549 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b201aa13-2bc8-47c0-8c5d-e92c747d1765 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:55.494757 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b201aa13-2bc8-47c0-8c5d-e92c747d1765 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:55.496257 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b201aa13-2bc8-47c0-8c5d-e92c747d1765 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:55.497011 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b201aa13-2bc8-47c0-8c5d-e92c747d1765 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:55.497952 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b201aa13-2bc8-47c0-8c5d-e92c747d1765 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:55.498812 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b201aa13-2bc8-47c0-8c5d-e92c747d1765 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:55.499548 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b201aa13-2bc8-47c0-8c5d-e92c747d1765 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:55.568256 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-07e3c6b6-fbcd-41ab-b752-b35c17199c54 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:55.579436 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-07e3c6b6-fbcd-41ab-b752-b35c17199c54 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:55.581742 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-07e3c6b6-fbcd-41ab-b752-b35c17199c54 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:55.585093 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-07e3c6b6-fbcd-41ab-b752-b35c17199c54 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.241842 Aug 05 20:44:55.593483 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 64/134] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:55 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:55.687872 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b201aa13-2bc8-47c0-8c5d-e92c747d1765 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:55.691691 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:55.699054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b201aa13-2bc8-47c0-8c5d-e92c747d1765 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.222681 Aug 05 20:44:55.700155 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 71/135] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:55 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:44:55.731924 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ce86cdf9-cdf9-4640-8ec5-49c529284c6e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:55.732883 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ce86cdf9-cdf9-4640-8ec5-49c529284c6e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:55.748187 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce86cdf9-cdf9-4640-8ec5-49c529284c6e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:55.749278 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce86cdf9-cdf9-4640-8ec5-49c529284c6e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:55.750364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce86cdf9-cdf9-4640-8ec5-49c529284c6e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:55.751205 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce86cdf9-cdf9-4640-8ec5-49c529284c6e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:55.752130 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce86cdf9-cdf9-4640-8ec5-49c529284c6e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:55.752873 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce86cdf9-cdf9-4640-8ec5-49c529284c6e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:55.759594 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=100 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:56.020291 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ce86cdf9-cdf9-4640-8ec5-49c529284c6e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:56.032396 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ce86cdf9-cdf9-4640-8ec5-49c529284c6e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1560 microversion: 2.1 time: 0.305077 Aug 05 20:44:56.033281 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 65/136] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:55 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1560 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:56.055060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d99d4140-61e8-4a8d-9b3b-4971790d7943 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:56.055648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d99d4140-61e8-4a8d-9b3b-4971790d7943 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:56.061988 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d99d4140-61e8-4a8d-9b3b-4971790d7943 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:56.062477 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d99d4140-61e8-4a8d-9b3b-4971790d7943 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:56.063224 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d99d4140-61e8-4a8d-9b3b-4971790d7943 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:56.064436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d99d4140-61e8-4a8d-9b3b-4971790d7943 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:56.064907 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d99d4140-61e8-4a8d-9b3b-4971790d7943 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:56.065316 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d99d4140-61e8-4a8d-9b3b-4971790d7943 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:56.204123 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d99d4140-61e8-4a8d-9b3b-4971790d7943 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153767 Aug 05 20:44:56.204739 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 72/137] 10.222.0.100 () {58 vars in 1280 bytes} [Fri Aug 5 20:44:56 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:44:56.340970 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1392de75-163a-4e62-9026-dfd1a5df58a8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:56.341586 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-1392de75-163a-4e62-9026-dfd1a5df58a8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:56.350004 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1392de75-163a-4e62-9026-dfd1a5df58a8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:56.350497 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1392de75-163a-4e62-9026-dfd1a5df58a8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:56.350934 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1392de75-163a-4e62-9026-dfd1a5df58a8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:56.351666 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1392de75-163a-4e62-9026-dfd1a5df58a8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:56.352118 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1392de75-163a-4e62-9026-dfd1a5df58a8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:56.352538 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1392de75-163a-4e62-9026-dfd1a5df58a8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:56.584146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-89881972-65f3-4dae-ac36-5aa438205148 req-a522c9b8-421a-465e-bbe2-12f28fbdba79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39afe8dc-01f2-4947-b48c-ac9664fb46cd", "name": "network-vif-plugged", "status": "completed", "tag": "34a70542-760a-48dc-85b0-7ef5bbff6348"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:56.605669 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-89881972-65f3-4dae-ac36-5aa438205148 req-a522c9b8-421a-465e-bbe2-12f28fbdba79 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:56.606191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-89881972-65f3-4dae-ac36-5aa438205148 req-a522c9b8-421a-465e-bbe2-12f28fbdba79 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:56.606629 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-89881972-65f3-4dae-ac36-5aa438205148 req-a522c9b8-421a-465e-bbe2-12f28fbdba79 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:56.627832 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-89881972-65f3-4dae-ac36-5aa438205148 req-a522c9b8-421a-465e-bbe2-12f28fbdba79 service nova] Creating event network-vif-plugged:34a70542-760a-48dc-85b0-7ef5bbff6348 for instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd on hv-cinder-85220 Aug 05 20:44:56.649183 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-89881972-65f3-4dae-ac36-5aa438205148 req-a522c9b8-421a-465e-bbe2-12f28fbdba79 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069093 Aug 05 20:44:56.649789 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 73/138] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:44:56.655580 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a7939852-bfe4-417b-9cc3-c104595320fc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:56.660330 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a7939852-bfe4-417b-9cc3-c104595320fc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:56.673953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a7939852-bfe4-417b-9cc3-c104595320fc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:56.675495 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a7939852-bfe4-417b-9cc3-c104595320fc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:56.676124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a7939852-bfe4-417b-9cc3-c104595320fc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:56.677227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a7939852-bfe4-417b-9cc3-c104595320fc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:56.677884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a7939852-bfe4-417b-9cc3-c104595320fc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:56.678571 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a7939852-bfe4-417b-9cc3-c104595320fc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:56.923557 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-1392de75-163a-4e62-9026-dfd1a5df58a8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:56.944511 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-1392de75-163a-4e62-9026-dfd1a5df58a8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.607849 Aug 05 20:44:56.945142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 66/139] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:56 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:56.963186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3db54539-4aad-49e7-a33d-27a307cda62f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:56.963885 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3db54539-4aad-49e7-a33d-27a307cda62f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:56.973248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3db54539-4aad-49e7-a33d-27a307cda62f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:56.973793 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3db54539-4aad-49e7-a33d-27a307cda62f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:56.974316 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3db54539-4aad-49e7-a33d-27a307cda62f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:56.975100 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3db54539-4aad-49e7-a33d-27a307cda62f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:56.975593 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3db54539-4aad-49e7-a33d-27a307cda62f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:56.976014 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3db54539-4aad-49e7-a33d-27a307cda62f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:57.135617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a7939852-bfe4-417b-9cc3-c104595320fc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:57.163848 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a7939852-bfe4-417b-9cc3-c104595320fc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:57.169864 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a7939852-bfe4-417b-9cc3-c104595320fc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:57.173024 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a7939852-bfe4-417b-9cc3-c104595320fc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1409 microversion: 2.20 time: 0.521876 Aug 05 20:44:57.186844 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 74/140] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:56 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1409 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:57.508385 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3db54539-4aad-49e7-a33d-27a307cda62f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:57.516477 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3db54539-4aad-49e7-a33d-27a307cda62f tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.557138 Aug 05 20:44:57.538402 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 67/141] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:56 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:57.967571 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d6d8c843-7a17-4eef-b124-99bd70fd0bcb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:57.968175 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d6d8c843-7a17-4eef-b124-99bd70fd0bcb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:57.976593 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6d8c843-7a17-4eef-b124-99bd70fd0bcb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:57.977302 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6d8c843-7a17-4eef-b124-99bd70fd0bcb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:57.977874 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6d8c843-7a17-4eef-b124-99bd70fd0bcb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:57.980144 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6d8c843-7a17-4eef-b124-99bd70fd0bcb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:57.980751 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6d8c843-7a17-4eef-b124-99bd70fd0bcb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:57.982697 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6d8c843-7a17-4eef-b124-99bd70fd0bcb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:58.201376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-335cf987-13a0-4d05-832b-d28012448fa4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:58.202231 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-335cf987-13a0-4d05-832b-d28012448fa4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:58.205483 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:44:58.220070 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-335cf987-13a0-4d05-832b-d28012448fa4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:58.220964 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-335cf987-13a0-4d05-832b-d28012448fa4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:58.225526 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-335cf987-13a0-4d05-832b-d28012448fa4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:58.227573 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-335cf987-13a0-4d05-832b-d28012448fa4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:58.228503 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-335cf987-13a0-4d05-832b-d28012448fa4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:58.229523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-335cf987-13a0-4d05-832b-d28012448fa4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:58.294050 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d6d8c843-7a17-4eef-b124-99bd70fd0bcb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:58.307379 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d6d8c843-7a17-4eef-b124-99bd70fd0bcb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1366 microversion: 2.1 time: 0.343850 Aug 05 20:44:58.324188 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 75/142] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:57 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:58.329259 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-42206df1-1551-4240-a3ce-c9431f6e3dc6 req-68232c0d-dc9d-47f1-812d-71afb6366c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c086ce48-8e37-432f-ab19-e87c53936473", "tag": "f6caac16-d258-4d36-8bff-99bcad0b9419"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:58.354060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-42206df1-1551-4240-a3ce-c9431f6e3dc6 req-68232c0d-dc9d-47f1-812d-71afb6366c76 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:58.361535 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-42206df1-1551-4240-a3ce-c9431f6e3dc6 req-68232c0d-dc9d-47f1-812d-71afb6366c76 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:58.361988 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-42206df1-1551-4240-a3ce-c9431f6e3dc6 req-68232c0d-dc9d-47f1-812d-71afb6366c76 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:58.378596 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-42206df1-1551-4240-a3ce-c9431f6e3dc6 req-68232c0d-dc9d-47f1-812d-71afb6366c76 service nova] Creating event network-changed:f6caac16-d258-4d36-8bff-99bcad0b9419 for instance c086ce48-8e37-432f-ab19-e87c53936473 on hv-cinder-85220 Aug 05 20:44:58.392920 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-42206df1-1551-4240-a3ce-c9431f6e3dc6 req-68232c0d-dc9d-47f1-812d-71afb6366c76 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067176 Aug 05 20:44:58.393553 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 76/143] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:44:58.541830 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4bbda9bf-c4fb-42fd-83c7-012dfe6cdc32 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:58.542961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4bbda9bf-c4fb-42fd-83c7-012dfe6cdc32 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:58.547699 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-335cf987-13a0-4d05-832b-d28012448fa4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:58.552585 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4bbda9bf-c4fb-42fd-83c7-012dfe6cdc32 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:58.553538 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4bbda9bf-c4fb-42fd-83c7-012dfe6cdc32 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:58.554520 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4bbda9bf-c4fb-42fd-83c7-012dfe6cdc32 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:58.555596 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4bbda9bf-c4fb-42fd-83c7-012dfe6cdc32 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:58.556542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4bbda9bf-c4fb-42fd-83c7-012dfe6cdc32 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:58.557164 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4bbda9bf-c4fb-42fd-83c7-012dfe6cdc32 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:58.557662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-335cf987-13a0-4d05-832b-d28012448fa4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:58.560242 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-335cf987-13a0-4d05-832b-d28012448fa4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:58.561455 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-335cf987-13a0-4d05-832b-d28012448fa4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1601 microversion: 2.20 time: 0.365191 Aug 05 20:44:58.562339 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 68/144] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:44:58 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1601 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:44:58.586089 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9873b3be-874b-4c91-af94-83968e83ea93 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:58.586895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9873b3be-874b-4c91-af94-83968e83ea93 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:58.594058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9873b3be-874b-4c91-af94-83968e83ea93 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:58.594480 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9873b3be-874b-4c91-af94-83968e83ea93 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:58.603954 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9873b3be-874b-4c91-af94-83968e83ea93 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:58.605306 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9873b3be-874b-4c91-af94-83968e83ea93 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:58.606175 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9873b3be-874b-4c91-af94-83968e83ea93 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:58.607450 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9873b3be-874b-4c91-af94-83968e83ea93 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:58.791189 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4bbda9bf-c4fb-42fd-83c7-012dfe6cdc32 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:44:58.799213 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9873b3be-874b-4c91-af94-83968e83ea93 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.217716 Aug 05 20:44:58.800304 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 69/145] 10.222.0.100 () {60 vars in 1321 bytes} [Fri Aug 5 20:44:58 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:44:58.802662 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4bbda9bf-c4fb-42fd-83c7-012dfe6cdc32 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.265299 Aug 05 20:44:58.803959 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 77/146] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:58 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:44:58.812646 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-07db7775-dc94-4001-8ec4-8bbb157e48ab req-faa5a728-6a13-4ab6-aa84-c505d975638a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d0d279-aa7f-4377-a9de-27b205539317", "name": "network-vif-plugged", "status": "completed", "tag": "a4ff702b-a590-46c1-a7b7-3cf69b3604dc"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:44:58.833847 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-07db7775-dc94-4001-8ec4-8bbb157e48ab req-faa5a728-6a13-4ab6-aa84-c505d975638a service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:58.834335 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-07db7775-dc94-4001-8ec4-8bbb157e48ab req-faa5a728-6a13-4ab6-aa84-c505d975638a service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:58.834763 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-07db7775-dc94-4001-8ec4-8bbb157e48ab req-faa5a728-6a13-4ab6-aa84-c505d975638a service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:58.853601 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-07db7775-dc94-4001-8ec4-8bbb157e48ab req-faa5a728-6a13-4ab6-aa84-c505d975638a service nova] Creating event network-vif-plugged:a4ff702b-a590-46c1-a7b7-3cf69b3604dc for instance 34d0d279-aa7f-4377-a9de-27b205539317 on hv-cinder-85220 Aug 05 20:44:58.875901 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-07db7775-dc94-4001-8ec4-8bbb157e48ab req-faa5a728-6a13-4ab6-aa84-c505d975638a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074050 Aug 05 20:44:58.876628 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 70/147] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:44:59.331890 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6cf72baf-4e7f-4651-a0f9-ca8e9e0c748a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:59.333859 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6cf72baf-4e7f-4651-a0f9-ca8e9e0c748a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:59.341539 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6cf72baf-4e7f-4651-a0f9-ca8e9e0c748a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:59.343326 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6cf72baf-4e7f-4651-a0f9-ca8e9e0c748a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:59.344198 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6cf72baf-4e7f-4651-a0f9-ca8e9e0c748a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:59.345966 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6cf72baf-4e7f-4651-a0f9-ca8e9e0c748a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:59.346775 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6cf72baf-4e7f-4651-a0f9-ca8e9e0c748a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:59.348242 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6cf72baf-4e7f-4651-a0f9-ca8e9e0c748a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:59.825163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-5b273c3f-abfb-4ee8-bf0f-1a91bb543c21 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:44:59.825826 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-5b273c3f-abfb-4ee8-bf0f-1a91bb543c21 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:44:59.837438 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5b273c3f-abfb-4ee8-bf0f-1a91bb543c21 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:59.837964 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5b273c3f-abfb-4ee8-bf0f-1a91bb543c21 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:59.838409 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5b273c3f-abfb-4ee8-bf0f-1a91bb543c21 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:44:59.839135 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5b273c3f-abfb-4ee8-bf0f-1a91bb543c21 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:44:59.841475 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5b273c3f-abfb-4ee8-bf0f-1a91bb543c21 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:44:59.841918 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5b273c3f-abfb-4ee8-bf0f-1a91bb543c21 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:00.647048 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-5b273c3f-abfb-4ee8-bf0f-1a91bb543c21 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:00.662556 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-5b273c3f-abfb-4ee8-bf0f-1a91bb543c21 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.839476 Aug 05 20:45:00.676600 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 71/148] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:59 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:45:00.718558 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6cf72baf-4e7f-4651-a0f9-ca8e9e0c748a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:00.749614 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6cf72baf-4e7f-4651-a0f9-ca8e9e0c748a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1551 microversion: 2.1 time: 1.422124 Aug 05 20:45:00.750225 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 78/149] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:44:59 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1551 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:00.773534 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d2243878-db1d-4556-bfaa-878f4e10cd11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:00.774033 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d2243878-db1d-4556-bfaa-878f4e10cd11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:00.776067 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=86 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:00.790346 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d2243878-db1d-4556-bfaa-878f4e10cd11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:00.790874 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d2243878-db1d-4556-bfaa-878f4e10cd11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:00.791619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d2243878-db1d-4556-bfaa-878f4e10cd11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:00.792325 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d2243878-db1d-4556-bfaa-878f4e10cd11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:00.792777 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d2243878-db1d-4556-bfaa-878f4e10cd11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:00.793311 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d2243878-db1d-4556-bfaa-878f4e10cd11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:01.179547 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d2243878-db1d-4556-bfaa-878f4e10cd11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.410194 Aug 05 20:45:01.192806 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 72/150] 10.222.0.100 () {58 vars in 1280 bytes} [Fri Aug 5 20:45:00 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/os-interface => generated 284 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:45:01.710764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9c2fbaff-9adc-42c1-bb14-87926b870578 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:01.712151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9c2fbaff-9adc-42c1-bb14-87926b870578 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:01.736691 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c2fbaff-9adc-42c1-bb14-87926b870578 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:01.738245 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c2fbaff-9adc-42c1-bb14-87926b870578 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:01.742836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c2fbaff-9adc-42c1-bb14-87926b870578 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:01.744664 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c2fbaff-9adc-42c1-bb14-87926b870578 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:01.750836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c2fbaff-9adc-42c1-bb14-87926b870578 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:01.751713 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c2fbaff-9adc-42c1-bb14-87926b870578 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:02.329902 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9c2fbaff-9adc-42c1-bb14-87926b870578 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:02.343869 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9c2fbaff-9adc-42c1-bb14-87926b870578 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1319 microversion: 2.1 time: 0.644176 Aug 05 20:45:02.344718 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 79/151] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:01 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1319 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:02.616785 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-1d3680ef-9cce-4572-818e-f7040460982d req-791f1e2c-32e2-4ff1-9a57-66ebbcc3b01f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20537f07-e2b8-4c88-8757-58c0b37570d2", "tag": "a196cd1a-7fd3-4c91-8b4f-d500d0c2740a"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:02.664788 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-1d3680ef-9cce-4572-818e-f7040460982d req-791f1e2c-32e2-4ff1-9a57-66ebbcc3b01f service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:02.665522 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-1d3680ef-9cce-4572-818e-f7040460982d req-791f1e2c-32e2-4ff1-9a57-66ebbcc3b01f service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:02.666461 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-1d3680ef-9cce-4572-818e-f7040460982d req-791f1e2c-32e2-4ff1-9a57-66ebbcc3b01f service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:02.694968 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-1d3680ef-9cce-4572-818e-f7040460982d req-791f1e2c-32e2-4ff1-9a57-66ebbcc3b01f service nova] Creating event network-changed:a196cd1a-7fd3-4c91-8b4f-d500d0c2740a for instance 20537f07-e2b8-4c88-8757-58c0b37570d2 on hv-cinder-85220 Aug 05 20:45:02.726830 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-1d3680ef-9cce-4572-818e-f7040460982d req-791f1e2c-32e2-4ff1-9a57-66ebbcc3b01f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111311 Aug 05 20:45:02.729798 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 73/152] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:45:03.199671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-240c7527-dace-4bb1-8ed5-aff3c4e483a0 req-c525bc83-b5df-4cbd-9dd1-2fa88dd2a392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39afe8dc-01f2-4947-b48c-ac9664fb46cd", "tag": "34a70542-760a-48dc-85b0-7ef5bbff6348"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:03.205908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=85 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:03.214598 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-240c7527-dace-4bb1-8ed5-aff3c4e483a0 req-c525bc83-b5df-4cbd-9dd1-2fa88dd2a392 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:03.215280 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-240c7527-dace-4bb1-8ed5-aff3c4e483a0 req-c525bc83-b5df-4cbd-9dd1-2fa88dd2a392 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:03.216065 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-240c7527-dace-4bb1-8ed5-aff3c4e483a0 req-c525bc83-b5df-4cbd-9dd1-2fa88dd2a392 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:03.230135 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-240c7527-dace-4bb1-8ed5-aff3c4e483a0 req-c525bc83-b5df-4cbd-9dd1-2fa88dd2a392 service nova] Creating event network-changed:34a70542-760a-48dc-85b0-7ef5bbff6348 for instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd on hv-cinder-85220 Aug 05 20:45:03.237558 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-240c7527-dace-4bb1-8ed5-aff3c4e483a0 req-c525bc83-b5df-4cbd-9dd1-2fa88dd2a392 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041705 Aug 05 20:45:03.243992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 80/153] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:45:03.368129 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-2c31ab01-6d6d-4857-be59-b5aa5b17300d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:03.369264 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-2c31ab01-6d6d-4857-be59-b5aa5b17300d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:03.380404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2c31ab01-6d6d-4857-be59-b5aa5b17300d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:03.385348 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2c31ab01-6d6d-4857-be59-b5aa5b17300d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:03.386091 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2c31ab01-6d6d-4857-be59-b5aa5b17300d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:03.387721 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2c31ab01-6d6d-4857-be59-b5aa5b17300d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:03.388679 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2c31ab01-6d6d-4857-be59-b5aa5b17300d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:03.389722 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2c31ab01-6d6d-4857-be59-b5aa5b17300d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:04.105829 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2c31ab01-6d6d-4857-be59-b5aa5b17300d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:04.116155 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-2c31ab01-6d6d-4857-be59-b5aa5b17300d tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1507 microversion: 2.1 time: 0.752801 Aug 05 20:45:04.116756 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 74/154] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:03 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1507 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:05.989096 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ec1ddb4d-7ea2-41eb-b333-bcf6b7888740 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3726ccb-db25-4769-b085-7dc5619914fc"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:05.993051 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ec1ddb4d-7ea2-41eb-b333-bcf6b7888740 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:06.001917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ec1ddb4d-7ea2-41eb-b333-bcf6b7888740 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:06.002712 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ec1ddb4d-7ea2-41eb-b333-bcf6b7888740 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:06.003738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ec1ddb4d-7ea2-41eb-b333-bcf6b7888740 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:06.005096 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ec1ddb4d-7ea2-41eb-b333-bcf6b7888740 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:06.007178 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ec1ddb4d-7ea2-41eb-b333-bcf6b7888740 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:06.007788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ec1ddb4d-7ea2-41eb-b333-bcf6b7888740 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:06.477979 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ec1ddb4d-7ea2-41eb-b333-bcf6b7888740 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "POST /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.522366 Aug 05 20:45:06.478852 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 81/155] 10.222.0.100 () {60 vars in 1328 bytes} [Fri Aug 5 20:45:05 2022] POST /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317/os-volume_attachments => generated 194 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:45:16.791859 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-74e790e4-cf6c-4b49-89ad-05f579641a92 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:16.793023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-74e790e4-cf6c-4b49-89ad-05f579641a92 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:16.798938 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=5 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:16.800547 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=46 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:16.802652 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-74e790e4-cf6c-4b49-89ad-05f579641a92 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:16.803215 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-74e790e4-cf6c-4b49-89ad-05f579641a92 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:16.803838 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-74e790e4-cf6c-4b49-89ad-05f579641a92 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:16.804641 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-74e790e4-cf6c-4b49-89ad-05f579641a92 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:16.805207 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-74e790e4-cf6c-4b49-89ad-05f579641a92 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:16.805729 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-74e790e4-cf6c-4b49-89ad-05f579641a92 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:16.833681 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-74e790e4-cf6c-4b49-89ad-05f579641a92 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Going to try to terminate instance {{(pid=124431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:45:16.938779 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-74e790e4-cf6c-4b49-89ad-05f579641a92 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "DELETE /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 204 len: 0 microversion: 2.1 time: 0.150249 Aug 05 20:45:16.939173 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 75/156] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:45:16 2022] DELETE /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:45:16.944955 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:16.945714 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:16.950087 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-387d487c-2f48-40e0-b034-939c0295fb1b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:16.950912 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-387d487c-2f48-40e0-b034-939c0295fb1b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:16.960722 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-387d487c-2f48-40e0-b034-939c0295fb1b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:16.961206 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-387d487c-2f48-40e0-b034-939c0295fb1b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:16.961632 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-387d487c-2f48-40e0-b034-939c0295fb1b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:16.962323 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-387d487c-2f48-40e0-b034-939c0295fb1b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:16.962772 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-387d487c-2f48-40e0-b034-939c0295fb1b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:16.963540 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-387d487c-2f48-40e0-b034-939c0295fb1b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:17.104146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-387d487c-2f48-40e0-b034-939c0295fb1b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:17.112638 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-387d487c-2f48-40e0-b034-939c0295fb1b tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1559 microversion: 2.1 time: 0.169021 Aug 05 20:45:17.113234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 82/157] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:16 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:18.134138 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ebba6b27-d7c3-4eec-86d7-25e37b44efea tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:18.134937 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ebba6b27-d7c3-4eec-86d7-25e37b44efea tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:18.140880 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ebba6b27-d7c3-4eec-86d7-25e37b44efea tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:18.141510 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ebba6b27-d7c3-4eec-86d7-25e37b44efea tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:18.142031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ebba6b27-d7c3-4eec-86d7-25e37b44efea tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:18.142837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ebba6b27-d7c3-4eec-86d7-25e37b44efea tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:18.143396 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ebba6b27-d7c3-4eec-86d7-25e37b44efea tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:18.143913 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ebba6b27-d7c3-4eec-86d7-25e37b44efea tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:18.281392 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ebba6b27-d7c3-4eec-86d7-25e37b44efea tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:18.289706 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ebba6b27-d7c3-4eec-86d7-25e37b44efea tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1559 microversion: 2.1 time: 0.160080 Aug 05 20:45:18.290280 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 76/158] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:18 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:19.312226 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6a6b3e2e-e6c7-4c6f-b3fe-ebf7fe34ea51 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:19.313439 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6a6b3e2e-e6c7-4c6f-b3fe-ebf7fe34ea51 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:19.320960 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6a6b3e2e-e6c7-4c6f-b3fe-ebf7fe34ea51 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:19.321659 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6a6b3e2e-e6c7-4c6f-b3fe-ebf7fe34ea51 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:19.322278 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6a6b3e2e-e6c7-4c6f-b3fe-ebf7fe34ea51 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:19.323163 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6a6b3e2e-e6c7-4c6f-b3fe-ebf7fe34ea51 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:19.324111 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6a6b3e2e-e6c7-4c6f-b3fe-ebf7fe34ea51 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:19.324728 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6a6b3e2e-e6c7-4c6f-b3fe-ebf7fe34ea51 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:19.468624 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6a6b3e2e-e6c7-4c6f-b3fe-ebf7fe34ea51 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:19.477720 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6a6b3e2e-e6c7-4c6f-b3fe-ebf7fe34ea51 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1559 microversion: 2.1 time: 0.170532 Aug 05 20:45:19.478490 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 83/159] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:19 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:20.500448 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-43fe8a8d-34c8-400f-a75d-5a51d0daf8d9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:20.501065 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-43fe8a8d-34c8-400f-a75d-5a51d0daf8d9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:20.508270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-43fe8a8d-34c8-400f-a75d-5a51d0daf8d9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:20.508768 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-43fe8a8d-34c8-400f-a75d-5a51d0daf8d9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:20.509203 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-43fe8a8d-34c8-400f-a75d-5a51d0daf8d9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:20.509899 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-43fe8a8d-34c8-400f-a75d-5a51d0daf8d9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:20.518004 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-43fe8a8d-34c8-400f-a75d-5a51d0daf8d9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:20.518004 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-43fe8a8d-34c8-400f-a75d-5a51d0daf8d9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:20.666524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-43fe8a8d-34c8-400f-a75d-5a51d0daf8d9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:20.674909 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-43fe8a8d-34c8-400f-a75d-5a51d0daf8d9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1559 microversion: 2.1 time: 0.178855 Aug 05 20:45:20.675501 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 77/160] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:20 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:21.698617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e9a3543c-cb7c-455a-91c0-b41caf1830a9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:21.699189 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e9a3543c-cb7c-455a-91c0-b41caf1830a9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:21.706773 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9a3543c-cb7c-455a-91c0-b41caf1830a9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:21.707518 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9a3543c-cb7c-455a-91c0-b41caf1830a9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:21.708271 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9a3543c-cb7c-455a-91c0-b41caf1830a9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:21.708976 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9a3543c-cb7c-455a-91c0-b41caf1830a9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:21.709571 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9a3543c-cb7c-455a-91c0-b41caf1830a9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:21.710164 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9a3543c-cb7c-455a-91c0-b41caf1830a9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:21.851845 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e9a3543c-cb7c-455a-91c0-b41caf1830a9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:21.860245 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e9a3543c-cb7c-455a-91c0-b41caf1830a9 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1559 microversion: 2.1 time: 0.166269 Aug 05 20:45:21.860799 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 84/161] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:21 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:22.883625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a4015d53-6650-4aff-b58c-b8e0116d681a tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:22.884842 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a4015d53-6650-4aff-b58c-b8e0116d681a tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:22.891676 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a4015d53-6650-4aff-b58c-b8e0116d681a tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:22.892169 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a4015d53-6650-4aff-b58c-b8e0116d681a tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:22.892598 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a4015d53-6650-4aff-b58c-b8e0116d681a tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:22.893289 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a4015d53-6650-4aff-b58c-b8e0116d681a tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:22.893743 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a4015d53-6650-4aff-b58c-b8e0116d681a tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:22.894158 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a4015d53-6650-4aff-b58c-b8e0116d681a tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:23.074541 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a4015d53-6650-4aff-b58c-b8e0116d681a tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:23.090596 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a4015d53-6650-4aff-b58c-b8e0116d681a tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1559 microversion: 2.1 time: 0.212080 Aug 05 20:45:23.092032 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 78/162] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:22 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:23.748833 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-02b15bde-58e0-4747-9c9a-3e162c6e00e3 req-0a1ae550-6a7b-493f-a86f-8bf604f43f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d0d279-aa7f-4377-a9de-27b205539317", "name": "network-vif-deleted", "tag": "a4ff702b-a590-46c1-a7b7-3cf69b3604dc"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:23.777729 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-02b15bde-58e0-4747-9c9a-3e162c6e00e3 req-0a1ae550-6a7b-493f-a86f-8bf604f43f13 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:23.778251 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-02b15bde-58e0-4747-9c9a-3e162c6e00e3 req-0a1ae550-6a7b-493f-a86f-8bf604f43f13 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:23.778681 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-02b15bde-58e0-4747-9c9a-3e162c6e00e3 req-0a1ae550-6a7b-493f-a86f-8bf604f43f13 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:23.804849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-02b15bde-58e0-4747-9c9a-3e162c6e00e3 req-0a1ae550-6a7b-493f-a86f-8bf604f43f13 service nova] Creating event network-vif-deleted:a4ff702b-a590-46c1-a7b7-3cf69b3604dc for instance 34d0d279-aa7f-4377-a9de-27b205539317 on hv-cinder-85220 Aug 05 20:45:23.811714 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-02b15bde-58e0-4747-9c9a-3e162c6e00e3 req-0a1ae550-6a7b-493f-a86f-8bf604f43f13 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070846 Aug 05 20:45:23.812753 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 85/163] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:45:24.114471 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8fdaf139-cf36-4b46-b762-761e19d76ae2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:24.116249 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8fdaf139-cf36-4b46-b762-761e19d76ae2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:24.124641 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8fdaf139-cf36-4b46-b762-761e19d76ae2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:24.127324 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8fdaf139-cf36-4b46-b762-761e19d76ae2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:24.128006 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8fdaf139-cf36-4b46-b762-761e19d76ae2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:24.136980 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8fdaf139-cf36-4b46-b762-761e19d76ae2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:24.138828 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8fdaf139-cf36-4b46-b762-761e19d76ae2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:24.142964 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8fdaf139-cf36-4b46-b762-761e19d76ae2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:24.249343 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8fdaf139-cf36-4b46-b762-761e19d76ae2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc2f277a1d04094a77c6a0c90420f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c32ca23c17400fb5388a652efacc54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:24.258751 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8fdaf139-cf36-4b46-b762-761e19d76ae2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 200 len: 1350 microversion: 2.1 time: 0.148438 Aug 05 20:45:24.271397 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 79/164] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:24 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:25.281810 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b4e499e5-1754-4fec-9c9d-b9f89b0d9672 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:25.282809 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b4e499e5-1754-4fec-9c9d-b9f89b0d9672 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:25.299246 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b4e499e5-1754-4fec-9c9d-b9f89b0d9672 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:25.300335 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b4e499e5-1754-4fec-9c9d-b9f89b0d9672 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:25.301041 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b4e499e5-1754-4fec-9c9d-b9f89b0d9672 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:25.302320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b4e499e5-1754-4fec-9c9d-b9f89b0d9672 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:25.303199 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b4e499e5-1754-4fec-9c9d-b9f89b0d9672 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:25.304138 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b4e499e5-1754-4fec-9c9d-b9f89b0d9672 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:25.321630 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-b4e499e5-1754-4fec-9c9d-b9f89b0d9672 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] HTTP exception thrown: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b4e499e5-1754-4fec-9c9d-b9f89b0d9672 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Request method failure captured: Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 HTTP/1.1 Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEcztBW1IuNgl8r3KlvpfzdVx7Oj_ZZH9nAVvYHlOFVPzszH_k31MhJsnfIm7j0XfjknkndCF572O_2AHcKCnHvT6hIQp1-bVA9LmL2aLKWFn_UeFrJp-8USbn7jOblrQC7txiSrRx3P9_8zrZQ5oPBBLEYmNfN6V7jeI4XQEIJiVk Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 46c32ca23c17400fb5388a652efacc54 Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-DeleteServersTestJSON-2117715475 Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:45:25.327827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:45:25.329354 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/46c32ca23c17400fb5388a652efacc54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/46c32ca23c17400fb5388a652efacc54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/46c32ca23c17400fb5388a652efacc54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_46c32ca23c17400fb5388a652efacc54", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:45:25.329354 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-DeleteServersTestJSON-2117715475 Aug 05 20:45:25.329354 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 46c32ca23c17400fb5388a652efacc54 Aug 05 20:45:25.329354 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-DeleteServersTestJSON-2117715475 Aug 05 20:45:25.329354 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-DeleteServersTestJSON-2117715475-project Aug 05 20:45:25.329354 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:45:25.329354 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:45:25.329354 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 4dc2f277a1d04094a77c6a0c90420f4a Aug 05 20:45:25.329354 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-DeleteServersTestJSON-2117715475-project Aug 05 20:45:25.329354 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:45:25.329354 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:25.329354 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '34d0d279-aa7f-4377-a9de-27b205539317'} Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:45:25.330180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:25.331970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:45:25.333780 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b4e499e5-1754-4fec-9c9d-b9f89b0d9672 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Returning 404 to user: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:45:25.333780 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b4e499e5-1754-4fec-9c9d-b9f89b0d9672 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 404 len: 111 microversion: 2.1 time: 0.054056 Aug 05 20:45:25.333780 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 86/165] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:25 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:45:25.470615 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c89b788b-6fc4-4eb5-9eea-b28bac21b39c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:25.472901 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c89b788b-6fc4-4eb5-9eea-b28bac21b39c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:25.479540 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c89b788b-6fc4-4eb5-9eea-b28bac21b39c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:25.480031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c89b788b-6fc4-4eb5-9eea-b28bac21b39c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:25.480479 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c89b788b-6fc4-4eb5-9eea-b28bac21b39c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:25.481167 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c89b788b-6fc4-4eb5-9eea-b28bac21b39c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:25.481614 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c89b788b-6fc4-4eb5-9eea-b28bac21b39c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:25.482039 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c89b788b-6fc4-4eb5-9eea-b28bac21b39c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:25.495393 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-c89b788b-6fc4-4eb5-9eea-b28bac21b39c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] HTTP exception thrown: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c89b788b-6fc4-4eb5-9eea-b28bac21b39c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Request method failure captured: Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317/os-volume_attachments HTTP/1.1 Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEcztBW1IuNgl8r3KlvpfzdVx7Oj_ZZH9nAVvYHlOFVPzszH_k31MhJsnfIm7j0XfjknkndCF572O_2AHcKCnHvT6hIQp1-bVA9LmL2aLKWFn_UeFrJp-8USbn7jOblrQC7txiSrRx3P9_8zrZQ5oPBBLEYmNfN6V7jeI4XQEIJiVk Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 46c32ca23c17400fb5388a652efacc54 Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-DeleteServersTestJSON-2117715475 Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:45:25.499736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:45:25.500868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/46c32ca23c17400fb5388a652efacc54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/46c32ca23c17400fb5388a652efacc54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/46c32ca23c17400fb5388a652efacc54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_46c32ca23c17400fb5388a652efacc54", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:45:25.500868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-DeleteServersTestJSON-2117715475 Aug 05 20:45:25.500868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 46c32ca23c17400fb5388a652efacc54 Aug 05 20:45:25.500868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-DeleteServersTestJSON-2117715475 Aug 05 20:45:25.500868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-DeleteServersTestJSON-2117715475-project Aug 05 20:45:25.500868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:45:25.500868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:45:25.500868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 4dc2f277a1d04094a77c6a0c90420f4a Aug 05 20:45:25.500868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-DeleteServersTestJSON-2117715475-project Aug 05 20:45:25.500868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:45:25.500868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:25.500868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'server_id': '34d0d279-aa7f-4377-a9de-27b205539317'} Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:45:25.501524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:25.502837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:45:25.505388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c89b788b-6fc4-4eb5-9eea-b28bac21b39c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Returning 404 to user: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:45:25.505388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c89b788b-6fc4-4eb5-9eea-b28bac21b39c tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034532 Aug 05 20:45:25.505388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 80/166] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:45:25 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:45:26.727958 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6f5715ec-b236-4085-bacf-53e4f890c8e2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:26.728621 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6f5715ec-b236-4085-bacf-53e4f890c8e2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:26.735689 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6f5715ec-b236-4085-bacf-53e4f890c8e2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:26.736212 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6f5715ec-b236-4085-bacf-53e4f890c8e2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:26.737439 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6f5715ec-b236-4085-bacf-53e4f890c8e2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:26.738312 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6f5715ec-b236-4085-bacf-53e4f890c8e2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:26.738817 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6f5715ec-b236-4085-bacf-53e4f890c8e2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:26.739642 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6f5715ec-b236-4085-bacf-53e4f890c8e2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:26.757318 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-6f5715ec-b236-4085-bacf-53e4f890c8e2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] HTTP exception thrown: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6f5715ec-b236-4085-bacf-53e4f890c8e2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Request method failure captured: Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 HTTP/1.1 Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEcztBW1IuNgl8r3KlvpfzdVx7Oj_ZZH9nAVvYHlOFVPzszH_k31MhJsnfIm7j0XfjknkndCF572O_2AHcKCnHvT6hIQp1-bVA9LmL2aLKWFn_UeFrJp-8USbn7jOblrQC7txiSrRx3P9_8zrZQ5oPBBLEYmNfN6V7jeI4XQEIJiVk Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 46c32ca23c17400fb5388a652efacc54 Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-DeleteServersTestJSON-2117715475 Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:45:26.758917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:45:26.761180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/46c32ca23c17400fb5388a652efacc54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/46c32ca23c17400fb5388a652efacc54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/46c32ca23c17400fb5388a652efacc54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_46c32ca23c17400fb5388a652efacc54", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:45:26.761180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-DeleteServersTestJSON-2117715475 Aug 05 20:45:26.761180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 46c32ca23c17400fb5388a652efacc54 Aug 05 20:45:26.761180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-DeleteServersTestJSON-2117715475 Aug 05 20:45:26.761180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-DeleteServersTestJSON-2117715475-project Aug 05 20:45:26.761180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:45:26.761180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:45:26.761180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 4dc2f277a1d04094a77c6a0c90420f4a Aug 05 20:45:26.761180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-DeleteServersTestJSON-2117715475-project Aug 05 20:45:26.761180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:45:26.761180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:26.761180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '34d0d279-aa7f-4377-a9de-27b205539317'} Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:45:26.763159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:26.766234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:45:26.768320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6f5715ec-b236-4085-bacf-53e4f890c8e2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Returning 404 to user: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:45:26.768320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6f5715ec-b236-4085-bacf-53e4f890c8e2 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "DELETE /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 404 len: 111 microversion: 2.1 time: 0.037190 Aug 05 20:45:26.768320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 87/167] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:45:26 2022] DELETE /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:45:26.772492 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e65290d4-36cd-4de5-b900-95e7213ce1d1 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:26.773109 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e65290d4-36cd-4de5-b900-95e7213ce1d1 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] [instance: 34d0d279-aa7f-4377-a9de-27b205539317] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:26.779116 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e65290d4-36cd-4de5-b900-95e7213ce1d1 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:26.779743 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e65290d4-36cd-4de5-b900-95e7213ce1d1 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:26.780177 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e65290d4-36cd-4de5-b900-95e7213ce1d1 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:26.781155 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e65290d4-36cd-4de5-b900-95e7213ce1d1 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:26.781623 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e65290d4-36cd-4de5-b900-95e7213ce1d1 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:26.782036 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e65290d4-36cd-4de5-b900-95e7213ce1d1 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:26.796051 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-e65290d4-36cd-4de5-b900-95e7213ce1d1 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] HTTP exception thrown: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e65290d4-36cd-4de5-b900-95e7213ce1d1 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Request method failure captured: Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 HTTP/1.1 Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEcztBW1IuNgl8r3KlvpfzdVx7Oj_ZZH9nAVvYHlOFVPzszH_k31MhJsnfIm7j0XfjknkndCF572O_2AHcKCnHvT6hIQp1-bVA9LmL2aLKWFn_UeFrJp-8USbn7jOblrQC7txiSrRx3P9_8zrZQ5oPBBLEYmNfN6V7jeI4XQEIJiVk Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 46c32ca23c17400fb5388a652efacc54 Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-DeleteServersTestJSON-2117715475 Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:45:26.798170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:45:26.799635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/46c32ca23c17400fb5388a652efacc54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/46c32ca23c17400fb5388a652efacc54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/46c32ca23c17400fb5388a652efacc54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_46c32ca23c17400fb5388a652efacc54", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:45:26.799635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-DeleteServersTestJSON-2117715475 Aug 05 20:45:26.799635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 46c32ca23c17400fb5388a652efacc54 Aug 05 20:45:26.799635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-DeleteServersTestJSON-2117715475 Aug 05 20:45:26.799635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-DeleteServersTestJSON-2117715475-project Aug 05 20:45:26.799635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:45:26.799635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:45:26.799635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 4dc2f277a1d04094a77c6a0c90420f4a Aug 05 20:45:26.799635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-DeleteServersTestJSON-2117715475-project Aug 05 20:45:26.799635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:45:26.799635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:26.799635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '34d0d279-aa7f-4377-a9de-27b205539317'} Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:45:26.800365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. Aug 05 20:45:26.801618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:45:26.803235 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e65290d4-36cd-4de5-b900-95e7213ce1d1 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] Returning 404 to user: Instance 34d0d279-aa7f-4377-a9de-27b205539317 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:45:26.803235 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e65290d4-36cd-4de5-b900-95e7213ce1d1 tempest-DeleteServersTestJSON-2117715475 tempest-DeleteServersTestJSON-2117715475-project] 10.222.0.100 "GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317" status: 404 len: 111 microversion: 2.1 time: 0.031185 Aug 05 20:45:26.803235 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 81/168] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:26 2022] GET /compute/v2.1/servers/34d0d279-aa7f-4377-a9de-27b205539317 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:45:34.351794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-906475047", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "networks": [{"uuid": "c9d6e45a-bb6c-48f9-a63b-6c8a62ac012e"}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:34.421848 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] validate_networks() for [('c9d6e45a-bb6c-48f9-a63b-6c8a62ac012e', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:45:35.003260 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:45:35.003706 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:45:35.004180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:45:35.004871 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:45:35.005295 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:45:35.027216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:35.031873 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:35.032451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:35.033592 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:35.034419 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:35.035039 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:35.064505 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Getting quotas for project e909b98552a841c988e49b79ba01fa64. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:45:35.072535 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Getting quotas for user 053d69835219410f9a669f3afd120263 and project e909b98552a841c988e49b79ba01fa64. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:45:35.091528 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:45:35.094393 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:45:35.213538 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-78841dd4-d8ba-415d-8819-bf1f2c054d7a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.859911 Aug 05 20:45:35.214883 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 88/169] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:45:34 2022] POST /compute/v2.1/servers => generated 382 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:45:35.225751 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-15ce23fd-695c-455d-8b6c-189d4abfd8f0 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:35.226366 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-15ce23fd-695c-455d-8b6c-189d4abfd8f0 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:35.352722 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-15ce23fd-695c-455d-8b6c-189d4abfd8f0 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:35.366830 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-15ce23fd-695c-455d-8b6c-189d4abfd8f0 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1217 microversion: 2.1 time: 0.144887 Aug 05 20:45:35.368263 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 82/170] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:35 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1217 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:36.388862 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-01c13888-4f74-481f-ad4a-61bbf93f50da tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:36.389484 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-01c13888-4f74-481f-ad4a-61bbf93f50da tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:36.399226 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-01c13888-4f74-481f-ad4a-61bbf93f50da tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:36.399662 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-01c13888-4f74-481f-ad4a-61bbf93f50da tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:36.400089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-01c13888-4f74-481f-ad4a-61bbf93f50da tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:36.400783 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-01c13888-4f74-481f-ad4a-61bbf93f50da tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:36.401265 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-01c13888-4f74-481f-ad4a-61bbf93f50da tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:36.401685 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-01c13888-4f74-481f-ad4a-61bbf93f50da tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:36.576768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-01c13888-4f74-481f-ad4a-61bbf93f50da tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:36.586753 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-01c13888-4f74-481f-ad4a-61bbf93f50da tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1269 microversion: 2.1 time: 0.201950 Aug 05 20:45:36.601439 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 89/171] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:36 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1269 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:37.608544 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ea6adc6b-bcea-4dc5-a2b0-eb12acd17189 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:37.609758 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ea6adc6b-bcea-4dc5-a2b0-eb12acd17189 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:37.612041 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:37.624648 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ea6adc6b-bcea-4dc5-a2b0-eb12acd17189 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:37.633371 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ea6adc6b-bcea-4dc5-a2b0-eb12acd17189 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:37.634033 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ea6adc6b-bcea-4dc5-a2b0-eb12acd17189 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:37.634816 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ea6adc6b-bcea-4dc5-a2b0-eb12acd17189 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:37.635298 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ea6adc6b-bcea-4dc5-a2b0-eb12acd17189 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:37.635761 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ea6adc6b-bcea-4dc5-a2b0-eb12acd17189 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:37.840176 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ea6adc6b-bcea-4dc5-a2b0-eb12acd17189 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:37.849007 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ea6adc6b-bcea-4dc5-a2b0-eb12acd17189 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1275 microversion: 2.1 time: 0.244420 Aug 05 20:45:37.851334 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 83/172] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:37 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1275 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:38.880984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3de7c832-d831-4611-9958-c77a42fc1354 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:38.882402 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3de7c832-d831-4611-9958-c77a42fc1354 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:38.891282 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3de7c832-d831-4611-9958-c77a42fc1354 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:38.892218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3de7c832-d831-4611-9958-c77a42fc1354 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:38.892839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3de7c832-d831-4611-9958-c77a42fc1354 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:38.893743 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3de7c832-d831-4611-9958-c77a42fc1354 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:38.894406 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3de7c832-d831-4611-9958-c77a42fc1354 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:38.895147 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3de7c832-d831-4611-9958-c77a42fc1354 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:39.483827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3de7c832-d831-4611-9958-c77a42fc1354 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:39.492293 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3de7c832-d831-4611-9958-c77a42fc1354 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1317 microversion: 2.1 time: 0.619554 Aug 05 20:45:39.492869 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 90/173] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:38 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:40.513368 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-aba942c9-8ee7-4729-9dd3-d20906369b50 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:40.513960 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-aba942c9-8ee7-4729-9dd3-d20906369b50 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:40.520684 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aba942c9-8ee7-4729-9dd3-d20906369b50 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:40.521109 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aba942c9-8ee7-4729-9dd3-d20906369b50 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:40.521550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aba942c9-8ee7-4729-9dd3-d20906369b50 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:40.522243 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aba942c9-8ee7-4729-9dd3-d20906369b50 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:40.522696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aba942c9-8ee7-4729-9dd3-d20906369b50 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:40.523118 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aba942c9-8ee7-4729-9dd3-d20906369b50 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:40.815434 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-9c6cac67-ac42-47e4-bebb-e6d7dea6f5dd req-f9fb3e98-c441-4243-ad28-a4de6e2427fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d4830a-4fd0-4f9c-89b1-b104f407bd7b", "tag": "b35d0ff2-7682-4ab0-991b-d4c1ac0142aa"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:40.830334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-9c6cac67-ac42-47e4-bebb-e6d7dea6f5dd req-f9fb3e98-c441-4243-ad28-a4de6e2427fc service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:40.830964 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-9c6cac67-ac42-47e4-bebb-e6d7dea6f5dd req-f9fb3e98-c441-4243-ad28-a4de6e2427fc service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:40.831568 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-9c6cac67-ac42-47e4-bebb-e6d7dea6f5dd req-f9fb3e98-c441-4243-ad28-a4de6e2427fc service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:40.845666 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-9c6cac67-ac42-47e4-bebb-e6d7dea6f5dd req-f9fb3e98-c441-4243-ad28-a4de6e2427fc service nova] Creating event network-changed:b35d0ff2-7682-4ab0-991b-d4c1ac0142aa for instance 21d4830a-4fd0-4f9c-89b1-b104f407bd7b on hv-cinder-85220 Aug 05 20:45:40.857579 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-9c6cac67-ac42-47e4-bebb-e6d7dea6f5dd req-f9fb3e98-c441-4243-ad28-a4de6e2427fc service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049520 Aug 05 20:45:40.859491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 91/174] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:45:41.248025 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-aba942c9-8ee7-4729-9dd3-d20906369b50 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:41.265647 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-aba942c9-8ee7-4729-9dd3-d20906369b50 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1317 microversion: 2.1 time: 0.756570 Aug 05 20:45:41.279037 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 84/175] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:40 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1317 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:42.290770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-61307077-af2d-4ed4-81b1-05ae0afd3977 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:42.291493 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-61307077-af2d-4ed4-81b1-05ae0afd3977 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:42.299250 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-61307077-af2d-4ed4-81b1-05ae0afd3977 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:42.299803 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-61307077-af2d-4ed4-81b1-05ae0afd3977 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:42.300159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-61307077-af2d-4ed4-81b1-05ae0afd3977 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:42.304375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-61307077-af2d-4ed4-81b1-05ae0afd3977 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:42.305081 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-61307077-af2d-4ed4-81b1-05ae0afd3977 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:42.305696 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-61307077-af2d-4ed4-81b1-05ae0afd3977 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:42.553844 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-61307077-af2d-4ed4-81b1-05ae0afd3977 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:42.568450 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-61307077-af2d-4ed4-81b1-05ae0afd3977 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1317 microversion: 2.1 time: 0.282022 Aug 05 20:45:42.569966 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 92/176] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:42 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:42.853050 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2031080997", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:42.922186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.network.neutron [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] validate_networks() for [('d3a56079-e01c-4484-8c24-d71366de1fc5', None, None, None, None, None)] {{(pid=124431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:45:43.593556 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f1d73c63-f80f-46a4-849c-e82a7dc79ccc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:43.595933 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f1d73c63-f80f-46a4-849c-e82a7dc79ccc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:43.608110 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f1d73c63-f80f-46a4-849c-e82a7dc79ccc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:43.611104 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f1d73c63-f80f-46a4-849c-e82a7dc79ccc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:43.611765 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f1d73c63-f80f-46a4-849c-e82a7dc79ccc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:43.612733 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f1d73c63-f80f-46a4-849c-e82a7dc79ccc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:43.614614 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f1d73c63-f80f-46a4-849c-e82a7dc79ccc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:43.615249 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f1d73c63-f80f-46a4-849c-e82a7dc79ccc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:44.918257 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f1d73c63-f80f-46a4-849c-e82a7dc79ccc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:44.946443 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f1d73c63-f80f-46a4-849c-e82a7dc79ccc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1317 microversion: 2.1 time: 1.353771 Aug 05 20:45:44.947108 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 93/177] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:43 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1317 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:45:44.981417 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Flavor limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:45:44.982346 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Image limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:45:44.983052 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Flavor pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:45:44.983796 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Image pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:45:44.984430 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:45:44.996841 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:44.997652 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:44.998254 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:44.999547 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:45.000773 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:45.001989 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:45.025409 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Getting quotas for project 80b5e8457f2d47b7a7c0d2856a513b77. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:45:45.030417 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Getting quotas for user 2a09fb7dd7ec47e5b37d533c3701a3a2 and project 80b5e8457f2d47b7a7c0d2856a513b77. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:45:45.076219 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Going to run 1 instances... {{(pid=124431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:45:45.080289 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:45:45.217147 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0b030362-4661-4f1c-9b6f-a875dd11ffc2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 2.587904 Aug 05 20:45:45.218179 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 85/178] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:45:42 2022] POST /compute/v2.1/servers => generated 385 bytes in 2590 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:45:45.229391 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-654f9ba3-ca87-4696-9e39-ad62ea69383a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:45.232475 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-654f9ba3-ca87-4696-9e39-ad62ea69383a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:45.236480 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:45.237983 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:45.409481 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-654f9ba3-ca87-4696-9e39-ad62ea69383a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:45.433016 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-654f9ba3-ca87-4696-9e39-ad62ea69383a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1226 microversion: 2.1 time: 0.205798 Aug 05 20:45:45.455902 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 94/179] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:45 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1226 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:45.456138 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f0699f7e-0e52-417c-b163-28fffbb133c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:45.456571 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f0699f7e-0e52-417c-b163-28fffbb133c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:45.475659 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f0699f7e-0e52-417c-b163-28fffbb133c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:45.476170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f0699f7e-0e52-417c-b163-28fffbb133c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:45.476616 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f0699f7e-0e52-417c-b163-28fffbb133c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:45.490163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f0699f7e-0e52-417c-b163-28fffbb133c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:45.490666 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f0699f7e-0e52-417c-b163-28fffbb133c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:45.491115 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f0699f7e-0e52-417c-b163-28fffbb133c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:45.582209 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f0699f7e-0e52-417c-b163-28fffbb133c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/ips" status: 200 len: 149 microversion: 2.1 time: 0.143658 Aug 05 20:45:45.583717 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 86/180] 10.222.0.100 () {58 vars in 1253 bytes} [Fri Aug 5 20:45:45 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/ips => generated 149 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:45:45.731875 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1968080906", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:45.845680 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] validate_networks() for [('d3a56079-e01c-4484-8c24-d71366de1fc5', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:45:45.972958 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0de0297e-a96e-4280-89a6-e65b000b7c0a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:45.973588 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0de0297e-a96e-4280-89a6-e65b000b7c0a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:45.984460 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0de0297e-a96e-4280-89a6-e65b000b7c0a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:45.988108 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0de0297e-a96e-4280-89a6-e65b000b7c0a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:45.988777 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0de0297e-a96e-4280-89a6-e65b000b7c0a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:45.992295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0de0297e-a96e-4280-89a6-e65b000b7c0a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:45.992728 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0de0297e-a96e-4280-89a6-e65b000b7c0a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:45.993172 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0de0297e-a96e-4280-89a6-e65b000b7c0a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:46.948562 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0de0297e-a96e-4280-89a6-e65b000b7c0a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:46.957134 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0de0297e-a96e-4280-89a6-e65b000b7c0a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1317 microversion: 2.1 time: 0.988489 Aug 05 20:45:46.971561 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 87/181] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:45 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1317 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:46.977798 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0c3e1ef0-d976-415c-9a61-95560ccf7926 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:46.979188 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0c3e1ef0-d976-415c-9a61-95560ccf7926 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:46.981852 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:46.990759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0c3e1ef0-d976-415c-9a61-95560ccf7926 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:46.992021 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0c3e1ef0-d976-415c-9a61-95560ccf7926 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:46.992629 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0c3e1ef0-d976-415c-9a61-95560ccf7926 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:46.993539 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0c3e1ef0-d976-415c-9a61-95560ccf7926 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:46.994193 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0c3e1ef0-d976-415c-9a61-95560ccf7926 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:46.994945 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0c3e1ef0-d976-415c-9a61-95560ccf7926 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:47.043397 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0c3e1ef0-d976-415c-9a61-95560ccf7926 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/ips" status: 200 len: 152 microversion: 2.20 time: 0.070018 Aug 05 20:45:47.062193 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 88/182] 10.222.0.100 () {60 vars in 1294 bytes} [Fri Aug 5 20:45:46 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/ips => generated 152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:45:47.218524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-8e6ad4ac-6350-4f20-ac0a-607b4269f53c req-21948b3d-7e2f-441f-8623-5971772b2a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d4830a-4fd0-4f9c-89b1-b104f407bd7b", "name": "network-vif-plugged", "status": "completed", "tag": "b35d0ff2-7682-4ab0-991b-d4c1ac0142aa"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:47.247744 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-8e6ad4ac-6350-4f20-ac0a-607b4269f53c req-21948b3d-7e2f-441f-8623-5971772b2a6a service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:47.255634 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-8e6ad4ac-6350-4f20-ac0a-607b4269f53c req-21948b3d-7e2f-441f-8623-5971772b2a6a service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:47.256133 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-8e6ad4ac-6350-4f20-ac0a-607b4269f53c req-21948b3d-7e2f-441f-8623-5971772b2a6a service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:47.265723 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:45:47.267320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:45:47.268146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:45:47.269073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:45:47.270141 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:45:47.277499 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:47.283059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-8e6ad4ac-6350-4f20-ac0a-607b4269f53c req-21948b3d-7e2f-441f-8623-5971772b2a6a service nova] Creating event network-vif-plugged:b35d0ff2-7682-4ab0-991b-d4c1ac0142aa for instance 21d4830a-4fd0-4f9c-89b1-b104f407bd7b on hv-cinder-85220 Aug 05 20:45:47.321491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:47.322015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:47.322465 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:47.323905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-8e6ad4ac-6350-4f20-ac0a-607b4269f53c req-21948b3d-7e2f-441f-8623-5971772b2a6a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099919 Aug 05 20:45:47.325412 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 89/183] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:45:47.327523 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:47.328319 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:47.328920 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:47.361602 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=53 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:47.376020 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Getting quotas for project 80b5e8457f2d47b7a7c0d2856a513b77. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:45:47.382151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Getting quotas for user 2a09fb7dd7ec47e5b37d533c3701a3a2 and project 80b5e8457f2d47b7a7c0d2856a513b77. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:45:47.405862 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-25bfb12f-1103-4e15-b22c-96b462bdebf2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26c1f759-8368-4127-87d1-1e5485757362"}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:47.408623 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-25bfb12f-1103-4e15-b22c-96b462bdebf2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:47.413443 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:45:47.416047 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:45:47.430110 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-25bfb12f-1103-4e15-b22c-96b462bdebf2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:47.430616 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-25bfb12f-1103-4e15-b22c-96b462bdebf2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:47.431065 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-25bfb12f-1103-4e15-b22c-96b462bdebf2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:47.431807 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-25bfb12f-1103-4e15-b22c-96b462bdebf2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:47.434101 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-25bfb12f-1103-4e15-b22c-96b462bdebf2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:47.435110 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-25bfb12f-1103-4e15-b22c-96b462bdebf2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:47.588108 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9dea4eb1-32a5-4f6c-addb-52d3187d1682 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.861990 Aug 05 20:45:47.596644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 95/184] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:45:45 2022] POST /compute/v2.1/servers => generated 385 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:45:47.648806 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-efc0b289-a242-4eec-9768-2281893c8d01 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:47.653105 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-efc0b289-a242-4eec-9768-2281893c8d01 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:48.076974 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-efc0b289-a242-4eec-9768-2281893c8d01 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:48.104985 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-efc0b289-a242-4eec-9768-2281893c8d01 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1226 microversion: 2.1 time: 0.500295 Aug 05 20:45:48.106716 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 96/185] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:47 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1226 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:48.111057 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-25bfb12f-1103-4e15-b22c-96b462bdebf2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "POST /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710150 Aug 05 20:45:48.117346 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 90/186] 10.222.0.100 () {60 vars in 1328 bytes} [Fri Aug 5 20:45:47 2022] POST /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/os-volume_attachments => generated 194 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:45:48.132563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-73187703-ca0d-45aa-90f8-0365ea85c3ae tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:48.133728 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-73187703-ca0d-45aa-90f8-0365ea85c3ae tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:48.158744 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73187703-ca0d-45aa-90f8-0365ea85c3ae tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:48.161141 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73187703-ca0d-45aa-90f8-0365ea85c3ae tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:48.187079 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73187703-ca0d-45aa-90f8-0365ea85c3ae tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:48.190841 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73187703-ca0d-45aa-90f8-0365ea85c3ae tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:48.193525 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73187703-ca0d-45aa-90f8-0365ea85c3ae tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:48.196078 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73187703-ca0d-45aa-90f8-0365ea85c3ae tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:48.721062 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-73187703-ca0d-45aa-90f8-0365ea85c3ae tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:48.754076 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-73187703-ca0d-45aa-90f8-0365ea85c3ae tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1317 microversion: 2.1 time: 0.642962 Aug 05 20:45:48.759688 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 97/187] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:48 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1317 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:49.138372 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f1ea3799-3099-4e96-bb3f-6d29fbf17398 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:49.140201 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f1ea3799-3099-4e96-bb3f-6d29fbf17398 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:49.171164 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1ea3799-3099-4e96-bb3f-6d29fbf17398 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:49.180862 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1ea3799-3099-4e96-bb3f-6d29fbf17398 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:49.182292 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1ea3799-3099-4e96-bb3f-6d29fbf17398 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:49.186592 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1ea3799-3099-4e96-bb3f-6d29fbf17398 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:49.189233 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1ea3799-3099-4e96-bb3f-6d29fbf17398 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:49.190657 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1ea3799-3099-4e96-bb3f-6d29fbf17398 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:49.331143 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f1ea3799-3099-4e96-bb3f-6d29fbf17398 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:49.339571 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f1ea3799-3099-4e96-bb3f-6d29fbf17398 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1278 microversion: 2.1 time: 0.215072 Aug 05 20:45:49.347016 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 91/188] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:49 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1278 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:49.483512 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0cc3ae3f-358c-47e5-8696-4f857e9da58e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:49.484501 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0cc3ae3f-358c-47e5-8696-4f857e9da58e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:49.502098 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0cc3ae3f-358c-47e5-8696-4f857e9da58e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:49.502718 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0cc3ae3f-358c-47e5-8696-4f857e9da58e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:49.503716 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0cc3ae3f-358c-47e5-8696-4f857e9da58e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:49.507593 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0cc3ae3f-358c-47e5-8696-4f857e9da58e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:49.508485 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0cc3ae3f-358c-47e5-8696-4f857e9da58e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:49.509655 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0cc3ae3f-358c-47e5-8696-4f857e9da58e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:49.570579 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-0cc3ae3f-358c-47e5-8696-4f857e9da58e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lazy-loading 'flavor' on Instance uuid 20537f07-e2b8-4c88-8757-58c0b37570d2 {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:45:49.777670 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-eb5318c2-d53d-4629-bbf2-5e9a36c52676 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:49.779176 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-eb5318c2-d53d-4629-bbf2-5e9a36c52676 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:49.788885 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eb5318c2-d53d-4629-bbf2-5e9a36c52676 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:49.792342 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eb5318c2-d53d-4629-bbf2-5e9a36c52676 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:49.793752 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eb5318c2-d53d-4629-bbf2-5e9a36c52676 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:49.795179 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eb5318c2-d53d-4629-bbf2-5e9a36c52676 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:49.800700 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eb5318c2-d53d-4629-bbf2-5e9a36c52676 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:49.801738 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-eb5318c2-d53d-4629-bbf2-5e9a36c52676 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:49.994873 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0cc3ae3f-358c-47e5-8696-4f857e9da58e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "POST /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/action" status: 202 len: 0 microversion: 2.20 time: 0.517225 Aug 05 20:45:49.996427 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 98/189] 10.222.0.100 () {62 vars in 1324 bytes} [Fri Aug 5 20:45:49 2022] POST /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:45:50.008070 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9e80ef24-04ba-4cbf-a5f8-9499fabc3fb5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:50.009193 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9e80ef24-04ba-4cbf-a5f8-9499fabc3fb5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:50.018450 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e80ef24-04ba-4cbf-a5f8-9499fabc3fb5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:50.019198 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e80ef24-04ba-4cbf-a5f8-9499fabc3fb5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:50.022205 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e80ef24-04ba-4cbf-a5f8-9499fabc3fb5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:50.023442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e80ef24-04ba-4cbf-a5f8-9499fabc3fb5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:50.024071 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e80ef24-04ba-4cbf-a5f8-9499fabc3fb5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:50.024674 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e80ef24-04ba-4cbf-a5f8-9499fabc3fb5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:50.071288 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-eb5318c2-d53d-4629-bbf2-5e9a36c52676 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:50.081736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-eb5318c2-d53d-4629-bbf2-5e9a36c52676 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1502 microversion: 2.1 time: 0.309244 Aug 05 20:45:50.101113 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 92/190] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:49 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1502 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:45:50.360296 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d7950652-8851-40ac-ab00-2b96376616b4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:50.361815 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d7950652-8851-40ac-ab00-2b96376616b4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:50.372812 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d7950652-8851-40ac-ab00-2b96376616b4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:50.378372 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d7950652-8851-40ac-ab00-2b96376616b4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:50.380685 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d7950652-8851-40ac-ab00-2b96376616b4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:50.383127 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d7950652-8851-40ac-ab00-2b96376616b4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:50.392288 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d7950652-8851-40ac-ab00-2b96376616b4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:50.394417 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d7950652-8851-40ac-ab00-2b96376616b4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:50.826508 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d7950652-8851-40ac-ab00-2b96376616b4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:50.834682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d7950652-8851-40ac-ab00-2b96376616b4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1296 microversion: 2.1 time: 0.478155 Aug 05 20:45:50.836020 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 93/191] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:50 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1296 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:50.841780 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-bbc0d4f8-9ee3-4b83-96e6-1cc010b3381e tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:50.842575 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-bbc0d4f8-9ee3-4b83-96e6-1cc010b3381e tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:50.849412 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bbc0d4f8-9ee3-4b83-96e6-1cc010b3381e tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:50.850927 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bbc0d4f8-9ee3-4b83-96e6-1cc010b3381e tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:50.851664 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bbc0d4f8-9ee3-4b83-96e6-1cc010b3381e tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:50.852605 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bbc0d4f8-9ee3-4b83-96e6-1cc010b3381e tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:50.853284 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bbc0d4f8-9ee3-4b83-96e6-1cc010b3381e tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:50.853920 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bbc0d4f8-9ee3-4b83-96e6-1cc010b3381e tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:50.880285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9e80ef24-04ba-4cbf-a5f8-9499fabc3fb5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:50.893591 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-bbc0d4f8-9ee3-4b83-96e6-1cc010b3381e tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Going to try to terminate instance {{(pid=124431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:45:50.899706 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9e80ef24-04ba-4cbf-a5f8-9499fabc3fb5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:50.901225 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9e80ef24-04ba-4cbf-a5f8-9499fabc3fb5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:50.902413 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9e80ef24-04ba-4cbf-a5f8-9499fabc3fb5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1726 microversion: 2.20 time: 0.901417 Aug 05 20:45:50.903173 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 99/192] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:45:49 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1726 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:45:51.024363 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-bbc0d4f8-9ee3-4b83-96e6-1cc010b3381e tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "DELETE /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 204 len: 0 microversion: 2.1 time: 0.186097 Aug 05 20:45:51.029143 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 94/193] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:45:50 2022] DELETE /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:45:51.033815 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3dedb41d-553a-483a-a183-946f19d1c5fc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:51.034727 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3dedb41d-553a-483a-a183-946f19d1c5fc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:51.041975 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3dedb41d-553a-483a-a183-946f19d1c5fc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:51.043348 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3dedb41d-553a-483a-a183-946f19d1c5fc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:51.043838 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3dedb41d-553a-483a-a183-946f19d1c5fc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:51.044937 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3dedb41d-553a-483a-a183-946f19d1c5fc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:51.046466 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3dedb41d-553a-483a-a183-946f19d1c5fc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:51.046905 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3dedb41d-553a-483a-a183-946f19d1c5fc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:51.392048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3dedb41d-553a-483a-a183-946f19d1c5fc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:51.401452 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3dedb41d-553a-483a-a183-946f19d1c5fc tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1508 microversion: 2.1 time: 0.372122 Aug 05 20:45:51.420563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 100/194] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:51 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1508 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:45:51.504967 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-5b160b9d-cc6e-4f2b-872b-65f590608330 req-fdb61166-e095-47ca-bdf8-06175d106429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "601febf0-78f3-4519-b08f-382dad6f8839", "tag": "ff52c57c-9320-4ee9-b916-9dde175b7580"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:51.533914 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-5b160b9d-cc6e-4f2b-872b-65f590608330 req-fdb61166-e095-47ca-bdf8-06175d106429 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:51.540420 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-5b160b9d-cc6e-4f2b-872b-65f590608330 req-fdb61166-e095-47ca-bdf8-06175d106429 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:51.541463 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-5b160b9d-cc6e-4f2b-872b-65f590608330 req-fdb61166-e095-47ca-bdf8-06175d106429 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:51.574616 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-5b160b9d-cc6e-4f2b-872b-65f590608330 req-fdb61166-e095-47ca-bdf8-06175d106429 service nova] Creating event network-changed:ff52c57c-9320-4ee9-b916-9dde175b7580 for instance 601febf0-78f3-4519-b08f-382dad6f8839 on hv-cinder-85220 Aug 05 20:45:51.584439 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-5b160b9d-cc6e-4f2b-872b-65f590608330 req-fdb61166-e095-47ca-bdf8-06175d106429 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086881 Aug 05 20:45:51.586922 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 95/195] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:45:51.858374 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-73c57388-d678-4791-a4cf-a77aacf8b183 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:51.858999 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-73c57388-d678-4791-a4cf-a77aacf8b183 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:51.871678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73c57388-d678-4791-a4cf-a77aacf8b183 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:51.872197 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73c57388-d678-4791-a4cf-a77aacf8b183 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:51.872640 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73c57388-d678-4791-a4cf-a77aacf8b183 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:51.873598 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73c57388-d678-4791-a4cf-a77aacf8b183 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:51.874169 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73c57388-d678-4791-a4cf-a77aacf8b183 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:51.874601 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73c57388-d678-4791-a4cf-a77aacf8b183 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:51.929651 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a97ea6ab-c9a1-458a-b794-431c01ae9d13 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:51.930360 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a97ea6ab-c9a1-458a-b794-431c01ae9d13 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:51.945495 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a97ea6ab-c9a1-458a-b794-431c01ae9d13 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:51.945997 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a97ea6ab-c9a1-458a-b794-431c01ae9d13 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:51.946432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a97ea6ab-c9a1-458a-b794-431c01ae9d13 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:51.947327 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a97ea6ab-c9a1-458a-b794-431c01ae9d13 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:51.947724 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a97ea6ab-c9a1-458a-b794-431c01ae9d13 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:51.967775 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a97ea6ab-c9a1-458a-b794-431c01ae9d13 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:52.432908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-73c57388-d678-4791-a4cf-a77aacf8b183 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:52.440153 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-73c57388-d678-4791-a4cf-a77aacf8b183 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1326 microversion: 2.1 time: 0.586528 Aug 05 20:45:52.454184 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 101/196] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:51 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1326 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:52.454184 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8ddd711d-f05b-42c3-b941-0527fae3761a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:52.454184 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8ddd711d-f05b-42c3-b941-0527fae3761a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:52.463882 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ddd711d-f05b-42c3-b941-0527fae3761a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:52.464385 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ddd711d-f05b-42c3-b941-0527fae3761a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:52.466939 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ddd711d-f05b-42c3-b941-0527fae3761a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:52.469633 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ddd711d-f05b-42c3-b941-0527fae3761a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:52.472577 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ddd711d-f05b-42c3-b941-0527fae3761a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:52.473044 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ddd711d-f05b-42c3-b941-0527fae3761a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:52.914182 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a97ea6ab-c9a1-458a-b794-431c01ae9d13 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:52.926186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a97ea6ab-c9a1-458a-b794-431c01ae9d13 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:52.933899 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a97ea6ab-c9a1-458a-b794-431c01ae9d13 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:52.937843 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a97ea6ab-c9a1-458a-b794-431c01ae9d13 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1726 microversion: 2.20 time: 1.011187 Aug 05 20:45:52.938684 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 96/197] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:45:51 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1726 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:45:52.955654 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-dcfe96b5-b297-4805-a8fc-93d2bf3b7174 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:52.956454 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-dcfe96b5-b297-4805-a8fc-93d2bf3b7174 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:52.986273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dcfe96b5-b297-4805-a8fc-93d2bf3b7174 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:52.987847 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dcfe96b5-b297-4805-a8fc-93d2bf3b7174 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:52.988566 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dcfe96b5-b297-4805-a8fc-93d2bf3b7174 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:52.989450 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dcfe96b5-b297-4805-a8fc-93d2bf3b7174 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:52.990068 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dcfe96b5-b297-4805-a8fc-93d2bf3b7174 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:52.990682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dcfe96b5-b297-4805-a8fc-93d2bf3b7174 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:53.028452 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-dcfe96b5-b297-4805-a8fc-93d2bf3b7174 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/ips" status: 200 len: 145 microversion: 2.1 time: 0.088394 Aug 05 20:45:53.029274 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 97/198] 10.222.0.100 () {58 vars in 1253 bytes} [Fri Aug 5 20:45:52 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/ips => generated 145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:45:53.362541 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8ddd711d-f05b-42c3-b941-0527fae3761a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:53.371824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8ddd711d-f05b-42c3-b941-0527fae3761a tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1508 microversion: 2.1 time: 0.926011 Aug 05 20:45:53.379949 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 102/199] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:52 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1508 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:53.463096 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c1dec7ce-99e2-4cc4-b5b1-b2746e6068e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:53.463768 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c1dec7ce-99e2-4cc4-b5b1-b2746e6068e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:53.473802 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c1dec7ce-99e2-4cc4-b5b1-b2746e6068e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:53.479539 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c1dec7ce-99e2-4cc4-b5b1-b2746e6068e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:53.480239 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c1dec7ce-99e2-4cc4-b5b1-b2746e6068e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:53.482461 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c1dec7ce-99e2-4cc4-b5b1-b2746e6068e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:53.486089 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c1dec7ce-99e2-4cc4-b5b1-b2746e6068e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:53.487093 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c1dec7ce-99e2-4cc4-b5b1-b2746e6068e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:53.981415 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a5df999c-9d76-4ba4-9021-f5967ff2b944 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:53.982042 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a5df999c-9d76-4ba4-9021-f5967ff2b944 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:54.005543 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a5df999c-9d76-4ba4-9021-f5967ff2b944 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:54.006327 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a5df999c-9d76-4ba4-9021-f5967ff2b944 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:54.006907 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a5df999c-9d76-4ba4-9021-f5967ff2b944 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:54.007802 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a5df999c-9d76-4ba4-9021-f5967ff2b944 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:54.008561 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a5df999c-9d76-4ba4-9021-f5967ff2b944 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:54.009958 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a5df999c-9d76-4ba4-9021-f5967ff2b944 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:54.576038 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a5df999c-9d76-4ba4-9021-f5967ff2b944 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:54.592806 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a5df999c-9d76-4ba4-9021-f5967ff2b944 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:54.599252 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a5df999c-9d76-4ba4-9021-f5967ff2b944 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:54.600767 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a5df999c-9d76-4ba4-9021-f5967ff2b944 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1726 microversion: 2.20 time: 0.628609 Aug 05 20:45:54.606992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 103/200] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:45:53 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1726 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:45:54.623772 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5a8c0e6f-1c15-4bc3-88ec-a91cfd50e895 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:54.624669 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5a8c0e6f-1c15-4bc3-88ec-a91cfd50e895 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:54.636743 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a8c0e6f-1c15-4bc3-88ec-a91cfd50e895 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:54.638421 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a8c0e6f-1c15-4bc3-88ec-a91cfd50e895 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:54.639649 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a8c0e6f-1c15-4bc3-88ec-a91cfd50e895 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:54.640787 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a8c0e6f-1c15-4bc3-88ec-a91cfd50e895 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:54.641455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a8c0e6f-1c15-4bc3-88ec-a91cfd50e895 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:54.642402 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a8c0e6f-1c15-4bc3-88ec-a91cfd50e895 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:55.010417 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c1dec7ce-99e2-4cc4-b5b1-b2746e6068e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:55.017271 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:55.027184 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c1dec7ce-99e2-4cc4-b5b1-b2746e6068e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1326 microversion: 2.1 time: 1.566147 Aug 05 20:45:55.035544 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 98/201] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:53 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1326 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:55.172644 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=8 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:55.179197 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0c1e20a1-da6b-4483-b4bf-138111677248 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Action: 'create', calling method: .version_select at 0x7f9bec0f90d0>, body: {"keypair": {"name": "tempest-keypair-1122232371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1bOAJWnd7hoCYKo9v9SN7eCslUrtXWDGVlirZiT6AA1diisQJeOHM5qEroekxSCGB8jrcqFb3sqO2QUv0Y5xDIs1i2cUFOkxkv9pxBPgGiSa2RQWrr7imCPjBoDGmjKg=="}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:55.214647 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-0c1e20a1-da6b-4483-b4bf-138111677248 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for project 8b67138a484f481099c562d7e3ca8401. Resources: {'key_pairs'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:45:55.237393 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-0c1e20a1-da6b-4483-b4bf-138111677248 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for user 8e1baad75342476aa0c64bda0414e334 and project 8b67138a484f481099c562d7e3ca8401. Resources: {'key_pairs'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:45:55.310553 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0c1e20a1-da6b-4483-b4bf-138111677248 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138266 Aug 05 20:45:55.312565 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 99/202] 10.222.0.100 () {60 vars in 1164 bytes} [Fri Aug 5 20:45:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:45:55.644635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a27c1c21-19c4-44a8-a6f1-d1ec38bd2a8f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:55.645860 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a27c1c21-19c4-44a8-a6f1-d1ec38bd2a8f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:55.672942 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a27c1c21-19c4-44a8-a6f1-d1ec38bd2a8f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:55.673447 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a27c1c21-19c4-44a8-a6f1-d1ec38bd2a8f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:55.673894 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a27c1c21-19c4-44a8-a6f1-d1ec38bd2a8f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:55.674614 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a27c1c21-19c4-44a8-a6f1-d1ec38bd2a8f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:55.676754 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a27c1c21-19c4-44a8-a6f1-d1ec38bd2a8f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:55.677203 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a27c1c21-19c4-44a8-a6f1-d1ec38bd2a8f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:55.753994 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:56.098646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5a8c0e6f-1c15-4bc3-88ec-a91cfd50e895 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:56.111927 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5a8c0e6f-1c15-4bc3-88ec-a91cfd50e895 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1508 microversion: 2.1 time: 1.501378 Aug 05 20:45:56.115910 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 104/203] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:54 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1508 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:56.126775 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e7d048be-4680-4039-8897-d2ad6a0eef5e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc31259b-9650-4e67-b671-bcf61140ee22"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:56.136328 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e7d048be-4680-4039-8897-d2ad6a0eef5e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:56.154117 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e7d048be-4680-4039-8897-d2ad6a0eef5e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:56.154997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e7d048be-4680-4039-8897-d2ad6a0eef5e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:56.156674 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e7d048be-4680-4039-8897-d2ad6a0eef5e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:56.157638 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e7d048be-4680-4039-8897-d2ad6a0eef5e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:56.158313 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e7d048be-4680-4039-8897-d2ad6a0eef5e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:56.159088 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e7d048be-4680-4039-8897-d2ad6a0eef5e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:56.721728 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a27c1c21-19c4-44a8-a6f1-d1ec38bd2a8f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:56.740864 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e7d048be-4680-4039-8897-d2ad6a0eef5e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "POST /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.617093 Aug 05 20:45:56.752971 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 105/204] 10.222.0.100 () {60 vars in 1328 bytes} [Fri Aug 5 20:45:56 2022] POST /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/os-volume_attachments => generated 194 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:45:56.765224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a27c1c21-19c4-44a8-a6f1-d1ec38bd2a8f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:56.770288 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a27c1c21-19c4-44a8-a6f1-d1ec38bd2a8f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:56.773610 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d5122679-9014-4f23-b257-4ea302da69ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:56.774723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a27c1c21-19c4-44a8-a6f1-d1ec38bd2a8f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1726 microversion: 2.20 time: 1.141335 Aug 05 20:45:56.775943 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d5122679-9014-4f23-b257-4ea302da69ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:56.776887 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 100/205] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:45:55 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1726 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:45:56.796379 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5122679-9014-4f23-b257-4ea302da69ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:56.798667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5122679-9014-4f23-b257-4ea302da69ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:56.802815 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5122679-9014-4f23-b257-4ea302da69ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:56.805550 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5122679-9014-4f23-b257-4ea302da69ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:56.808243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5122679-9014-4f23-b257-4ea302da69ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:56.809136 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5122679-9014-4f23-b257-4ea302da69ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:57.141224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-488d3670-1844-4927-9bfc-6f2499107b30 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:57.142275 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-488d3670-1844-4927-9bfc-6f2499107b30 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:57.153418 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-488d3670-1844-4927-9bfc-6f2499107b30 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:57.154331 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-488d3670-1844-4927-9bfc-6f2499107b30 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:57.155028 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-488d3670-1844-4927-9bfc-6f2499107b30 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:57.156869 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-488d3670-1844-4927-9bfc-6f2499107b30 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:57.160561 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-488d3670-1844-4927-9bfc-6f2499107b30 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:57.163534 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-488d3670-1844-4927-9bfc-6f2499107b30 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:57.361926 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:57.626851 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-488d3670-1844-4927-9bfc-6f2499107b30 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:57.650910 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-488d3670-1844-4927-9bfc-6f2499107b30 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1466 microversion: 2.1 time: 0.516438 Aug 05 20:45:57.657273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 101/206] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:57 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1466 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:45:57.671349 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-492a022f-cf0f-4a33-94e7-2aa1e544dbba req-c857ab7c-e650-49bd-8722-ca441713de72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "424981e0-db2d-449a-a636-3bb3b031f7da", "tag": "5c3c2d43-cbba-4420-8c65-04c62e695ae7"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:57.738034 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-492a022f-cf0f-4a33-94e7-2aa1e544dbba req-c857ab7c-e650-49bd-8722-ca441713de72 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:57.738935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-492a022f-cf0f-4a33-94e7-2aa1e544dbba req-c857ab7c-e650-49bd-8722-ca441713de72 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:57.746039 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-492a022f-cf0f-4a33-94e7-2aa1e544dbba req-c857ab7c-e650-49bd-8722-ca441713de72 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:57.766301 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d5122679-9014-4f23-b257-4ea302da69ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:57.779485 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d5122679-9014-4f23-b257-4ea302da69ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1326 microversion: 2.1 time: 1.024514 Aug 05 20:45:57.785736 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 106/207] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:56 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1326 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:57.798462 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-492a022f-cf0f-4a33-94e7-2aa1e544dbba req-c857ab7c-e650-49bd-8722-ca441713de72 service nova] Creating event network-changed:5c3c2d43-cbba-4420-8c65-04c62e695ae7 for instance 424981e0-db2d-449a-a636-3bb3b031f7da on hv-cinder-85220 Aug 05 20:45:57.803099 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ded96312-5179-4510-aa48-38a3c630806f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:57.804095 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ded96312-5179-4510-aa48-38a3c630806f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:57.812156 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ded96312-5179-4510-aa48-38a3c630806f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:57.815161 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-492a022f-cf0f-4a33-94e7-2aa1e544dbba req-c857ab7c-e650-49bd-8722-ca441713de72 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150890 Aug 05 20:45:57.817491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ded96312-5179-4510-aa48-38a3c630806f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:57.819619 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ded96312-5179-4510-aa48-38a3c630806f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:57.823613 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ded96312-5179-4510-aa48-38a3c630806f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:57.824275 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 102/208] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:45:57.824936 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ded96312-5179-4510-aa48-38a3c630806f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:57.830785 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ded96312-5179-4510-aa48-38a3c630806f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:58.099652 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=10 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:45:58.172331 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ded96312-5179-4510-aa48-38a3c630806f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:58.186126 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ded96312-5179-4510-aa48-38a3c630806f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:58.188159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ded96312-5179-4510-aa48-38a3c630806f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:58.189655 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ded96312-5179-4510-aa48-38a3c630806f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1726 microversion: 2.20 time: 0.391426 Aug 05 20:45:58.196119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 107/209] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:45:57 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1726 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:45:58.680824 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-bde85be8-abc4-4850-8375-ec59bc8e8736 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:58.681323 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-bde85be8-abc4-4850-8375-ec59bc8e8736 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:58.711831 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bde85be8-abc4-4850-8375-ec59bc8e8736 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:58.719172 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bde85be8-abc4-4850-8375-ec59bc8e8736 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:58.719793 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bde85be8-abc4-4850-8375-ec59bc8e8736 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:58.731254 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bde85be8-abc4-4850-8375-ec59bc8e8736 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:58.734256 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bde85be8-abc4-4850-8375-ec59bc8e8736 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:58.735454 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bde85be8-abc4-4850-8375-ec59bc8e8736 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:58.818545 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-93530819-8c6c-46fa-a7fe-efb40f4e084a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:58.819842 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-93530819-8c6c-46fa-a7fe-efb40f4e084a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:58.820222 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bde85be8-abc4-4850-8375-ec59bc8e8736 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:58.821225 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bde85be8-abc4-4850-8375-ec59bc8e8736 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:58.821818 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bde85be8-abc4-4850-8375-ec59bc8e8736 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:58.822438 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-bde85be8-abc4-4850-8375-ec59bc8e8736 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lazy-loading 'fault' on Instance uuid 21d4830a-4fd0-4f9c-89b1-b104f407bd7b {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:45:58.828737 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-93530819-8c6c-46fa-a7fe-efb40f4e084a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:58.829240 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-93530819-8c6c-46fa-a7fe-efb40f4e084a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:58.829687 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-93530819-8c6c-46fa-a7fe-efb40f4e084a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:58.830395 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-93530819-8c6c-46fa-a7fe-efb40f4e084a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:58.830856 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-93530819-8c6c-46fa-a7fe-efb40f4e084a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:58.831283 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-93530819-8c6c-46fa-a7fe-efb40f4e084a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:58.927810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-bde85be8-abc4-4850-8375-ec59bc8e8736 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:58.940250 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-bde85be8-abc4-4850-8375-ec59bc8e8736 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 200 len: 1307 microversion: 2.1 time: 0.266032 Aug 05 20:45:58.945922 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 103/210] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:58 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 1307 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:59.101716 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-93530819-8c6c-46fa-a7fe-efb40f4e084a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:59.110710 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-93530819-8c6c-46fa-a7fe-efb40f4e084a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1326 microversion: 2.1 time: 0.298034 Aug 05 20:45:59.111309 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 108/211] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:58 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1326 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:45:59.224475 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0370abd3-1a54-4bd4-9693-d61e9f3221a0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:59.225016 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0370abd3-1a54-4bd4-9693-d61e9f3221a0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:59.251053 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0370abd3-1a54-4bd4-9693-d61e9f3221a0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:59.251862 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0370abd3-1a54-4bd4-9693-d61e9f3221a0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:59.252457 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0370abd3-1a54-4bd4-9693-d61e9f3221a0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:59.254277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0370abd3-1a54-4bd4-9693-d61e9f3221a0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:59.255008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0370abd3-1a54-4bd4-9693-d61e9f3221a0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:59.256342 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0370abd3-1a54-4bd4-9693-d61e9f3221a0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:59.588420 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0370abd3-1a54-4bd4-9693-d61e9f3221a0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:59.601685 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0370abd3-1a54-4bd4-9693-d61e9f3221a0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:59.603266 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0370abd3-1a54-4bd4-9693-d61e9f3221a0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:45:59.604605 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0370abd3-1a54-4bd4-9693-d61e9f3221a0 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1726 microversion: 2.20 time: 0.385753 Aug 05 20:45:59.619622 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 104/212] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:45:59 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1726 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:45:59.921980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-a336cb86-3280-4aa8-a2c3-94b5094bf388 req-992420e1-9cf9-46af-84f8-a965337ae8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d4830a-4fd0-4f9c-89b1-b104f407bd7b", "name": "network-vif-deleted", "tag": "b35d0ff2-7682-4ab0-991b-d4c1ac0142aa"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:45:59.942353 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a336cb86-3280-4aa8-a2c3-94b5094bf388 req-992420e1-9cf9-46af-84f8-a965337ae8a2 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:59.943083 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a336cb86-3280-4aa8-a2c3-94b5094bf388 req-992420e1-9cf9-46af-84f8-a965337ae8a2 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:59.943721 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a336cb86-3280-4aa8-a2c3-94b5094bf388 req-992420e1-9cf9-46af-84f8-a965337ae8a2 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:59.956465 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-a336cb86-3280-4aa8-a2c3-94b5094bf388 req-992420e1-9cf9-46af-84f8-a965337ae8a2 service nova] Creating event network-vif-deleted:b35d0ff2-7682-4ab0-991b-d4c1ac0142aa for instance 21d4830a-4fd0-4f9c-89b1-b104f407bd7b on hv-cinder-85220 Aug 05 20:45:59.966196 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-138e7089-bdaf-4d9e-97a4-030b099c4f06 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:45:59.967547 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-138e7089-bdaf-4d9e-97a4-030b099c4f06 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 21d4830a-4fd0-4f9c-89b1-b104f407bd7b] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:45:59.975070 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-a336cb86-3280-4aa8-a2c3-94b5094bf388 req-992420e1-9cf9-46af-84f8-a965337ae8a2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055175 Aug 05 20:45:59.981789 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 109/213] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:45:59.982272 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-138e7089-bdaf-4d9e-97a4-030b099c4f06 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:59.983024 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-138e7089-bdaf-4d9e-97a4-030b099c4f06 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:59.983904 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-138e7089-bdaf-4d9e-97a4-030b099c4f06 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:45:59.984858 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-138e7089-bdaf-4d9e-97a4-030b099c4f06 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:45:59.985471 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-138e7089-bdaf-4d9e-97a4-030b099c4f06 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:45:59.986050 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-138e7089-bdaf-4d9e-97a4-030b099c4f06 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:00.006407 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-138e7089-bdaf-4d9e-97a4-030b099c4f06 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] HTTP exception thrown: Instance 21d4830a-4fd0-4f9c-89b1-b104f407bd7b could not be found. Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-138e7089-bdaf-4d9e-97a4-030b099c4f06 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Request method failure captured: Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b HTTP/1.1 Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YFssqhvQWpgxHc3XBka6vgALjEBVCniOjAorT-WWFxJ96ivbi1Um-XXokP_6Q_UG2DoBKdmrJscH02LHb7ODuOiEymXcu8qBZ38sAO6yGoOefzxAifVY7sYY3tItfFL9yFKnZDPscNyLBYPS344U4W3p9WHJ_1F5IqlBTU1RRykv_E Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: e909b98552a841c988e49b79ba01fa64 Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-VolumesActionsTest-493479436 Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:46:00.008696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:46:00.009979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e909b98552a841c988e49b79ba01fa64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e909b98552a841c988e49b79ba01fa64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e909b98552a841c988e49b79ba01fa64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e909b98552a841c988e49b79ba01fa64", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:46:00.009979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-VolumesActionsTest-493479436 Aug 05 20:46:00.009979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: e909b98552a841c988e49b79ba01fa64 Aug 05 20:46:00.009979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-VolumesActionsTest-493479436 Aug 05 20:46:00.009979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-VolumesActionsTest-493479436-project Aug 05 20:46:00.009979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:46:00.009979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:46:00.009979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 053d69835219410f9a669f3afd120263 Aug 05 20:46:00.009979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-VolumesActionsTest-493479436-project Aug 05 20:46:00.009979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:46:00.009979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 21d4830a-4fd0-4f9c-89b1-b104f407bd7b could not be found. Aug 05 20:46:00.009979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '21d4830a-4fd0-4f9c-89b1-b104f407bd7b'} Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d4830a-4fd0-4f9c-89b1-b104f407bd7b could not be found. Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:46:00.010905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d4830a-4fd0-4f9c-89b1-b104f407bd7b could not be found. Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d4830a-4fd0-4f9c-89b1-b104f407bd7b could not be found. Aug 05 20:46:00.012277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:46:00.014390 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-138e7089-bdaf-4d9e-97a4-030b099c4f06 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Returning 404 to user: Instance 21d4830a-4fd0-4f9c-89b1-b104f407bd7b could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:46:00.016220 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-138e7089-bdaf-4d9e-97a4-030b099c4f06 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b" status: 404 len: 111 microversion: 2.1 time: 0.053636 Aug 05 20:46:00.017415 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 105/214] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:45:59 2022] GET /compute/v2.1/servers/21d4830a-4fd0-4f9c-89b1-b104f407bd7b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:46:00.133906 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-bbe85c67-bbed-4925-8bea-d659e6c75110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:00.134920 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-bbe85c67-bbed-4925-8bea-d659e6c75110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:00.149961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bbe85c67-bbed-4925-8bea-d659e6c75110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:00.155343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bbe85c67-bbed-4925-8bea-d659e6c75110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:00.157171 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bbe85c67-bbed-4925-8bea-d659e6c75110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:00.158102 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bbe85c67-bbed-4925-8bea-d659e6c75110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:00.158900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bbe85c67-bbed-4925-8bea-d659e6c75110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:00.159535 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bbe85c67-bbed-4925-8bea-d659e6c75110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:00.330479 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1097682089", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "networks": [{"uuid": "c9d6e45a-bb6c-48f9-a63b-6c8a62ac012e"}]}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:00.471102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.network.neutron [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] validate_networks() for [('c9d6e45a-bb6c-48f9-a63b-6c8a62ac012e', None, None, None, None, None)] {{(pid=124431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:46:00.487947 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-bbe85c67-bbed-4925-8bea-d659e6c75110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:00.490369 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:00.504460 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-bbe85c67-bbed-4925-8bea-d659e6c75110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1326 microversion: 2.1 time: 0.375703 Aug 05 20:46:00.504920 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 110/215] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:00 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1326 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:00.636187 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b3d86d8c-79c5-4631-8117-33f8da0d3279 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:00.636866 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b3d86d8c-79c5-4631-8117-33f8da0d3279 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:00.663778 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b3d86d8c-79c5-4631-8117-33f8da0d3279 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:00.664646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b3d86d8c-79c5-4631-8117-33f8da0d3279 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:00.665255 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b3d86d8c-79c5-4631-8117-33f8da0d3279 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:00.668966 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b3d86d8c-79c5-4631-8117-33f8da0d3279 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:00.669785 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b3d86d8c-79c5-4631-8117-33f8da0d3279 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:00.671349 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b3d86d8c-79c5-4631-8117-33f8da0d3279 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:01.213309 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b3d86d8c-79c5-4631-8117-33f8da0d3279 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:01.233491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b3d86d8c-79c5-4631-8117-33f8da0d3279 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:01.235436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b3d86d8c-79c5-4631-8117-33f8da0d3279 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:01.238869 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b3d86d8c-79c5-4631-8117-33f8da0d3279 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1726 microversion: 2.20 time: 0.612046 Aug 05 20:46:01.240039 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 111/216] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:00 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1726 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:01.264191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-294487212", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9bbc8caf-4605-4dc8-9bf5-6e59e633b041"}], "security_groups": [{"name": "tempest-securitygroup--1738015669"}], "key_name": "tempest-keypair-1122232371", "user_data": "}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:01.622932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] validate_networks() for [('9bbc8caf-4605-4dc8-9bf5-6e59e633b041', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:46:02.753847 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Flavor limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:46:02.755030 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Image limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:46:02.755699 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Flavor pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:46:02.756259 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Image pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:46:02.756849 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:46:02.777357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:02.778180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:02.778783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:02.783071 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:02.783858 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:02.784464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:02.830958 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Getting quotas for project e909b98552a841c988e49b79ba01fa64. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:46:02.842913 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Getting quotas for user 053d69835219410f9a669f3afd120263 and project e909b98552a841c988e49b79ba01fa64. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:46:02.883644 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Going to run 1 instances... {{(pid=124431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:46:02.888136 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:46:03.037091 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-7aebf3dc-749b-42cb-ad58-9e2fc0d39217 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.710412 Aug 05 20:46:03.047400 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 106/217] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:46:00 2022] POST /compute/v2.1/servers => generated 382 bytes in 2721 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 05 20:46:03.053195 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-585bac00-6bff-4bb3-8c72-d93cfe0a7b13 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:03.054011 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-585bac00-6bff-4bb3-8c72-d93cfe0a7b13 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:03.065272 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-585bac00-6bff-4bb3-8c72-d93cfe0a7b13 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:03.066000 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-585bac00-6bff-4bb3-8c72-d93cfe0a7b13 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:03.066959 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-585bac00-6bff-4bb3-8c72-d93cfe0a7b13 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:03.068264 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-585bac00-6bff-4bb3-8c72-d93cfe0a7b13 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:03.068878 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-585bac00-6bff-4bb3-8c72-d93cfe0a7b13 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:03.069570 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-585bac00-6bff-4bb3-8c72-d93cfe0a7b13 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:03.975032 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:46:03.975514 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:46:03.976441 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:46:03.977011 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:46:03.977574 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:46:03.983326 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-585bac00-6bff-4bb3-8c72-d93cfe0a7b13 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:03.994880 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-585bac00-6bff-4bb3-8c72-d93cfe0a7b13 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1326 microversion: 2.1 time: 0.945698 Aug 05 20:46:03.995492 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 107/218] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:03 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1326 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:04.008459 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:04.008459 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:04.008459 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:04.008459 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:04.009139 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:04.009139 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:04.021690 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4ff3e2a4-3a8e-42c6-a064-5bfd5ced2a18 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:04.022579 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4ff3e2a4-3a8e-42c6-a064-5bfd5ced2a18 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:04.057585 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ff3e2a4-3a8e-42c6-a064-5bfd5ced2a18 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:04.063038 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ff3e2a4-3a8e-42c6-a064-5bfd5ced2a18 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:04.065256 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ff3e2a4-3a8e-42c6-a064-5bfd5ced2a18 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:04.067401 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ff3e2a4-3a8e-42c6-a064-5bfd5ced2a18 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:04.069599 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ff3e2a4-3a8e-42c6-a064-5bfd5ced2a18 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:04.072494 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ff3e2a4-3a8e-42c6-a064-5bfd5ced2a18 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:04.093312 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for project 8b67138a484f481099c562d7e3ca8401. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:46:04.105787 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for user 8e1baad75342476aa0c64bda0414e334 and project 8b67138a484f481099c562d7e3ca8401. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:46:04.144088 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:46:04.154635 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:46:04.307640 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3b6ded31-2a97-4bd6-8559-e6e4532dc0cf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.065600 Aug 05 20:46:04.308951 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 112/219] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:46:01 2022] POST /compute/v2.1/servers => generated 404 bytes in 3068 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:46:04.325763 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-23450485-6c1e-4d07-a456-de9062c193c4 req-4b1f3030-2c78-4478-bec6-1802d231a6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "601febf0-78f3-4519-b08f-382dad6f8839", "name": "network-vif-plugged", "status": "completed", "tag": "ff52c57c-9320-4ee9-b916-9dde175b7580"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:04.353421 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-23450485-6c1e-4d07-a456-de9062c193c4 req-4b1f3030-2c78-4478-bec6-1802d231a6f5 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:04.358030 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-23450485-6c1e-4d07-a456-de9062c193c4 req-4b1f3030-2c78-4478-bec6-1802d231a6f5 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:04.358767 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-23450485-6c1e-4d07-a456-de9062c193c4 req-4b1f3030-2c78-4478-bec6-1802d231a6f5 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:04.399705 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-23450485-6c1e-4d07-a456-de9062c193c4 req-4b1f3030-2c78-4478-bec6-1802d231a6f5 service nova] Creating event network-vif-plugged:ff52c57c-9320-4ee9-b916-9dde175b7580 for instance 601febf0-78f3-4519-b08f-382dad6f8839 on hv-cinder-85220 Aug 05 20:46:04.412920 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-23450485-6c1e-4d07-a456-de9062c193c4 req-4b1f3030-2c78-4478-bec6-1802d231a6f5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098402 Aug 05 20:46:04.425351 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 113/220] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:46:04.449560 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4ff3e2a4-3a8e-42c6-a064-5bfd5ced2a18 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:04.477625 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d5138180-df02-4be5-be81-eaf29e8d5efe tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:04.479213 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4ff3e2a4-3a8e-42c6-a064-5bfd5ced2a18 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:04.486852 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4ff3e2a4-3a8e-42c6-a064-5bfd5ced2a18 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:04.489335 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d5138180-df02-4be5-be81-eaf29e8d5efe tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:04.502096 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4ff3e2a4-3a8e-42c6-a064-5bfd5ced2a18 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1726 microversion: 2.20 time: 0.486199 Aug 05 20:46:04.513435 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 108/221] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:04 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1726 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:04.531611 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5138180-df02-4be5-be81-eaf29e8d5efe tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:04.537814 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5138180-df02-4be5-be81-eaf29e8d5efe tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:04.538102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-00c2702b-f2d1-430c-9ea8-44c216822c0a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:04.542916 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5138180-df02-4be5-be81-eaf29e8d5efe tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:04.545276 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5138180-df02-4be5-be81-eaf29e8d5efe tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:04.547048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5138180-df02-4be5-be81-eaf29e8d5efe tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:04.548824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d5138180-df02-4be5-be81-eaf29e8d5efe tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:04.559841 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-00c2702b-f2d1-430c-9ea8-44c216822c0a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:04.572535 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-00c2702b-f2d1-430c-9ea8-44c216822c0a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:04.575244 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-00c2702b-f2d1-430c-9ea8-44c216822c0a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:04.755613 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d5138180-df02-4be5-be81-eaf29e8d5efe tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:04.766497 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d5138180-df02-4be5-be81-eaf29e8d5efe tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1214 microversion: 2.1 time: 0.336782 Aug 05 20:46:04.768350 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 114/222] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:04 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1214 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:04.775179 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-23645a2e-cb40-4182-9692-b9d87a97e094 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:04.776074 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-23645a2e-cb40-4182-9692-b9d87a97e094 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:04.838470 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-00c2702b-f2d1-430c-9ea8-44c216822c0a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Going to try to stop instance {{(pid=124431) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 20:46:04.939575 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-00c2702b-f2d1-430c-9ea8-44c216822c0a tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "POST /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/action" status: 202 len: 0 microversion: 2.1 time: 0.424337 Aug 05 20:46:04.942909 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 109/223] 10.222.0.100 () {60 vars in 1283 bytes} [Fri Aug 5 20:46:04 2022] POST /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:46:04.952305 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-23adf3da-fe70-446b-ab39-878446b484ec tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:04.956049 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-23adf3da-fe70-446b-ab39-878446b484ec tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:04.972283 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-23adf3da-fe70-446b-ab39-878446b484ec tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:04.972999 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-23adf3da-fe70-446b-ab39-878446b484ec tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:04.976601 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-23adf3da-fe70-446b-ab39-878446b484ec tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:04.977572 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-23adf3da-fe70-446b-ab39-878446b484ec tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:04.978205 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-23adf3da-fe70-446b-ab39-878446b484ec tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:04.979054 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-23adf3da-fe70-446b-ab39-878446b484ec tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:04.987875 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-23645a2e-cb40-4182-9692-b9d87a97e094 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:04.995819 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-23645a2e-cb40-4182-9692-b9d87a97e094 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1245 microversion: 2.1 time: 0.225859 Aug 05 20:46:05.001849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 115/224] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:04 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1245 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:05.023207 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-60fb31dd-a7be-4d50-9404-bff0bb03efdb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:05.030797 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-60fb31dd-a7be-4d50-9404-bff0bb03efdb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:05.053906 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-60fb31dd-a7be-4d50-9404-bff0bb03efdb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:05.063961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-60fb31dd-a7be-4d50-9404-bff0bb03efdb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:05.064854 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-60fb31dd-a7be-4d50-9404-bff0bb03efdb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:05.065963 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-60fb31dd-a7be-4d50-9404-bff0bb03efdb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:05.066794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-60fb31dd-a7be-4d50-9404-bff0bb03efdb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:05.067505 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-60fb31dd-a7be-4d50-9404-bff0bb03efdb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:05.560844 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-23adf3da-fe70-446b-ab39-878446b484ec tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:05.570834 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-23adf3da-fe70-446b-ab39-878446b484ec tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1726 microversion: 2.1 time: 0.625482 Aug 05 20:46:05.592686 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 110/225] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:04 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1726 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:05.602129 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9eed95d9-bff7-4047-820f-c8703ef0a154 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:05.603040 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9eed95d9-bff7-4047-820f-c8703ef0a154 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:05.618860 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9eed95d9-bff7-4047-820f-c8703ef0a154 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:05.620733 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9eed95d9-bff7-4047-820f-c8703ef0a154 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:05.621187 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9eed95d9-bff7-4047-820f-c8703ef0a154 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:05.621919 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9eed95d9-bff7-4047-820f-c8703ef0a154 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:05.622375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9eed95d9-bff7-4047-820f-c8703ef0a154 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:05.622801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9eed95d9-bff7-4047-820f-c8703ef0a154 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:05.637218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-60fb31dd-a7be-4d50-9404-bff0bb03efdb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:05.649655 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-60fb31dd-a7be-4d50-9404-bff0bb03efdb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1326 microversion: 2.1 time: 0.630292 Aug 05 20:46:05.654449 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 116/226] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:05 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1326 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:05.796597 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6fc5408f-a9d5-4e38-8ffe-d703d6b1a89c tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:05.798154 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6fc5408f-a9d5-4e38-8ffe-d703d6b1a89c tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:05.816195 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6fc5408f-a9d5-4e38-8ffe-d703d6b1a89c tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:05.816979 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6fc5408f-a9d5-4e38-8ffe-d703d6b1a89c tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:05.817528 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6fc5408f-a9d5-4e38-8ffe-d703d6b1a89c tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:05.818733 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6fc5408f-a9d5-4e38-8ffe-d703d6b1a89c tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:05.819517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6fc5408f-a9d5-4e38-8ffe-d703d6b1a89c tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:05.820383 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6fc5408f-a9d5-4e38-8ffe-d703d6b1a89c tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:05.990989 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6fc5408f-a9d5-4e38-8ffe-d703d6b1a89c tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:06.005437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6fc5408f-a9d5-4e38-8ffe-d703d6b1a89c tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1270 microversion: 2.1 time: 0.217010 Aug 05 20:46:06.006907 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 117/227] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:05 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1270 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:06.014893 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-9eed95d9-bff7-4047-820f-c8703ef0a154 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:06.037009 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f9644880-0e7a-473b-b9cd-6dae7a5a6689 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:06.038074 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-9eed95d9-bff7-4047-820f-c8703ef0a154 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:06.038975 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f9644880-0e7a-473b-b9cd-6dae7a5a6689 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:06.043118 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-9eed95d9-bff7-4047-820f-c8703ef0a154 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:06.046270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9eed95d9-bff7-4047-820f-c8703ef0a154 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1726 microversion: 2.20 time: 0.451895 Aug 05 20:46:06.050004 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 111/228] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:05 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1726 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:06.056324 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9644880-0e7a-473b-b9cd-6dae7a5a6689 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:06.057150 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9644880-0e7a-473b-b9cd-6dae7a5a6689 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:06.059892 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9644880-0e7a-473b-b9cd-6dae7a5a6689 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:06.060964 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9644880-0e7a-473b-b9cd-6dae7a5a6689 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:06.062961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9644880-0e7a-473b-b9cd-6dae7a5a6689 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:06.064515 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9644880-0e7a-473b-b9cd-6dae7a5a6689 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:06.203449 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f9644880-0e7a-473b-b9cd-6dae7a5a6689 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:06.230911 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f9644880-0e7a-473b-b9cd-6dae7a5a6689 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1249 microversion: 2.1 time: 0.204552 Aug 05 20:46:06.231879 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 118/229] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:06 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1249 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:06.512813 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-cf11ed5c-9929-469a-9937-24313285272a req-d815a10b-162a-40b9-9859-9a68005c771e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424981e0-db2d-449a-a636-3bb3b031f7da", "name": "network-vif-plugged", "status": "completed", "tag": "5c3c2d43-cbba-4420-8c65-04c62e695ae7"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:06.543673 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-cf11ed5c-9929-469a-9937-24313285272a req-d815a10b-162a-40b9-9859-9a68005c771e service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:06.544516 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-cf11ed5c-9929-469a-9937-24313285272a req-d815a10b-162a-40b9-9859-9a68005c771e service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:06.547315 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-cf11ed5c-9929-469a-9937-24313285272a req-d815a10b-162a-40b9-9859-9a68005c771e service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:06.583565 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-cf11ed5c-9929-469a-9937-24313285272a req-d815a10b-162a-40b9-9859-9a68005c771e service nova] Creating event network-vif-plugged:5c3c2d43-cbba-4420-8c65-04c62e695ae7 for instance 424981e0-db2d-449a-a636-3bb3b031f7da on hv-cinder-85220 Aug 05 20:46:06.600618 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a991c424-4c3a-4b93-be94-ed4c4311c38f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:06.601616 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a991c424-4c3a-4b93-be94-ed4c4311c38f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:06.608606 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-cf11ed5c-9929-469a-9937-24313285272a req-d815a10b-162a-40b9-9859-9a68005c771e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102059 Aug 05 20:46:06.609214 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 112/230] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:46:06.618427 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a991c424-4c3a-4b93-be94-ed4c4311c38f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:06.622992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a991c424-4c3a-4b93-be94-ed4c4311c38f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:06.626945 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a991c424-4c3a-4b93-be94-ed4c4311c38f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:06.627923 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a991c424-4c3a-4b93-be94-ed4c4311c38f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:06.632754 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a991c424-4c3a-4b93-be94-ed4c4311c38f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:06.636311 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a991c424-4c3a-4b93-be94-ed4c4311c38f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:06.671586 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-15fc3cc7-34b9-4b6f-be0a-c797d454970c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:06.672536 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-15fc3cc7-34b9-4b6f-be0a-c797d454970c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:06.691760 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15fc3cc7-34b9-4b6f-be0a-c797d454970c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:06.694656 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15fc3cc7-34b9-4b6f-be0a-c797d454970c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:06.695911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15fc3cc7-34b9-4b6f-be0a-c797d454970c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:06.707349 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15fc3cc7-34b9-4b6f-be0a-c797d454970c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:06.708408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15fc3cc7-34b9-4b6f-be0a-c797d454970c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:06.712290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15fc3cc7-34b9-4b6f-be0a-c797d454970c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:07.756804 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a991c424-4c3a-4b93-be94-ed4c4311c38f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:07.777382 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a991c424-4c3a-4b93-be94-ed4c4311c38f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1726 microversion: 2.1 time: 1.170520 Aug 05 20:46:07.791387 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 119/231] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:06 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1726 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:07.791387 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-43a41124-fd60-4e89-93c3-587ed9025435 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:07.791387 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-43a41124-fd60-4e89-93c3-587ed9025435 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:07.801375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43a41124-fd60-4e89-93c3-587ed9025435 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:07.801375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43a41124-fd60-4e89-93c3-587ed9025435 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:07.801375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43a41124-fd60-4e89-93c3-587ed9025435 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:07.802108 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43a41124-fd60-4e89-93c3-587ed9025435 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:07.802556 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43a41124-fd60-4e89-93c3-587ed9025435 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:07.803491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43a41124-fd60-4e89-93c3-587ed9025435 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:07.860064 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-15fc3cc7-34b9-4b6f-be0a-c797d454970c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:07.877470 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-15fc3cc7-34b9-4b6f-be0a-c797d454970c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1326 microversion: 2.1 time: 1.210817 Aug 05 20:46:07.890660 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 113/232] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:06 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1326 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:07.890660 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-2e159cdf-9277-40c5-8cb1-9fbac66666a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:07.890660 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-2e159cdf-9277-40c5-8cb1-9fbac66666a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:07.905115 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2e159cdf-9277-40c5-8cb1-9fbac66666a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:07.905880 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2e159cdf-9277-40c5-8cb1-9fbac66666a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:07.906321 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2e159cdf-9277-40c5-8cb1-9fbac66666a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:07.915111 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2e159cdf-9277-40c5-8cb1-9fbac66666a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:07.915713 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2e159cdf-9277-40c5-8cb1-9fbac66666a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:07.916173 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2e159cdf-9277-40c5-8cb1-9fbac66666a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:08.039176 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-43a41124-fd60-4e89-93c3-587ed9025435 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:08.047446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-43a41124-fd60-4e89-93c3-587ed9025435 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1276 microversion: 2.1 time: 0.268104 Aug 05 20:46:08.052761 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 120/233] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:07 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1276 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:08.062890 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f74ce749-3b79-4756-9347-82440224f566 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:08.070542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f74ce749-3b79-4756-9347-82440224f566 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:08.081487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f74ce749-3b79-4756-9347-82440224f566 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:08.082058 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f74ce749-3b79-4756-9347-82440224f566 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:08.091876 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f74ce749-3b79-4756-9347-82440224f566 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:08.092648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f74ce749-3b79-4756-9347-82440224f566 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:08.093121 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f74ce749-3b79-4756-9347-82440224f566 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:08.093546 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f74ce749-3b79-4756-9347-82440224f566 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:08.312068 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f74ce749-3b79-4756-9347-82440224f566 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:08.328849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f74ce749-3b79-4756-9347-82440224f566 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1297 microversion: 2.1 time: 0.274254 Aug 05 20:46:08.329555 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 121/234] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:08 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1297 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:08.572264 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2e159cdf-9277-40c5-8cb1-9fbac66666a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:08.582019 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2e159cdf-9277-40c5-8cb1-9fbac66666a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:08.586881 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2e159cdf-9277-40c5-8cb1-9fbac66666a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:08.596756 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-2e159cdf-9277-40c5-8cb1-9fbac66666a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1747 microversion: 2.20 time: 0.716954 Aug 05 20:46:08.597573 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 114/235] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:07 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1747 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:08.802583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-69e60a25-6792-4a4d-acb7-9f7b270aade5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:08.803187 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-69e60a25-6792-4a4d-acb7-9f7b270aade5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:08.811228 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-69e60a25-6792-4a4d-acb7-9f7b270aade5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:08.812348 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-69e60a25-6792-4a4d-acb7-9f7b270aade5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:08.813568 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-69e60a25-6792-4a4d-acb7-9f7b270aade5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:08.819491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-69e60a25-6792-4a4d-acb7-9f7b270aade5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:08.819491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-69e60a25-6792-4a4d-acb7-9f7b270aade5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:08.819491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-69e60a25-6792-4a4d-acb7-9f7b270aade5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:08.901570 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-10e3007e-352d-4697-bb9a-f78a2f6a08ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:08.903006 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-10e3007e-352d-4697-bb9a-f78a2f6a08ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:08.913479 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10e3007e-352d-4697-bb9a-f78a2f6a08ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:08.916122 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10e3007e-352d-4697-bb9a-f78a2f6a08ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:08.917222 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10e3007e-352d-4697-bb9a-f78a2f6a08ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:08.918778 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10e3007e-352d-4697-bb9a-f78a2f6a08ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:08.919254 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10e3007e-352d-4697-bb9a-f78a2f6a08ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:08.919724 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10e3007e-352d-4697-bb9a-f78a2f6a08ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:09.935687 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-69e60a25-6792-4a4d-acb7-9f7b270aade5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:09.956879 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-69e60a25-6792-4a4d-acb7-9f7b270aade5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1726 microversion: 2.1 time: 1.155455 Aug 05 20:46:09.974474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 122/236] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:08 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1726 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:09.999025 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-10e3007e-352d-4697-bb9a-f78a2f6a08ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:10.026855 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-dd46ada5-6c6e-46c5-948d-60419579c8e4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:10.031916 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-dd46ada5-6c6e-46c5-948d-60419579c8e4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:10.033513 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-10e3007e-352d-4697-bb9a-f78a2f6a08ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1326 microversion: 2.1 time: 1.138102 Aug 05 20:46:10.040837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 115/237] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:08 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1326 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:10.064640 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd46ada5-6c6e-46c5-948d-60419579c8e4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:10.069813 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-40008d50-14ce-4a06-b7f2-5f963c8b2fa8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:10.070244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd46ada5-6c6e-46c5-948d-60419579c8e4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:10.072053 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd46ada5-6c6e-46c5-948d-60419579c8e4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:10.073532 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd46ada5-6c6e-46c5-948d-60419579c8e4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:10.097177 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-40008d50-14ce-4a06-b7f2-5f963c8b2fa8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:10.101945 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd46ada5-6c6e-46c5-948d-60419579c8e4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:10.111000 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd46ada5-6c6e-46c5-948d-60419579c8e4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:10.147628 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-40008d50-14ce-4a06-b7f2-5f963c8b2fa8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:10.150316 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-40008d50-14ce-4a06-b7f2-5f963c8b2fa8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:10.152462 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-40008d50-14ce-4a06-b7f2-5f963c8b2fa8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:10.157641 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-40008d50-14ce-4a06-b7f2-5f963c8b2fa8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:10.162858 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-40008d50-14ce-4a06-b7f2-5f963c8b2fa8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:10.163587 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-40008d50-14ce-4a06-b7f2-5f963c8b2fa8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:10.509840 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-40008d50-14ce-4a06-b7f2-5f963c8b2fa8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:10.522498 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-40008d50-14ce-4a06-b7f2-5f963c8b2fa8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1303 microversion: 2.1 time: 0.478040 Aug 05 20:46:10.523094 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 116/238] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:10 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1303 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:10.527961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f2395a14-6edd-4385-b3b1-4972a172ac43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:10.529218 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f2395a14-6edd-4385-b3b1-4972a172ac43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:10.537278 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f2395a14-6edd-4385-b3b1-4972a172ac43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:10.537765 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f2395a14-6edd-4385-b3b1-4972a172ac43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:10.538192 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f2395a14-6edd-4385-b3b1-4972a172ac43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:10.539674 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f2395a14-6edd-4385-b3b1-4972a172ac43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:10.540139 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f2395a14-6edd-4385-b3b1-4972a172ac43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:10.540559 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f2395a14-6edd-4385-b3b1-4972a172ac43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:10.901139 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-dd46ada5-6c6e-46c5-948d-60419579c8e4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:10.909832 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-dd46ada5-6c6e-46c5-948d-60419579c8e4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1318 microversion: 2.1 time: 0.934080 Aug 05 20:46:10.924443 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 123/239] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:09 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1318 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:10.985586 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b8453a02-0737-45fb-8ffc-03e0f70fa0f1 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:10.988013 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b8453a02-0737-45fb-8ffc-03e0f70fa0f1 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:11.004442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b8453a02-0737-45fb-8ffc-03e0f70fa0f1 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:11.007846 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b8453a02-0737-45fb-8ffc-03e0f70fa0f1 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:11.008879 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b8453a02-0737-45fb-8ffc-03e0f70fa0f1 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:11.009849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b8453a02-0737-45fb-8ffc-03e0f70fa0f1 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:11.012187 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b8453a02-0737-45fb-8ffc-03e0f70fa0f1 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:11.015058 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b8453a02-0737-45fb-8ffc-03e0f70fa0f1 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:11.290915 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f2395a14-6edd-4385-b3b1-4972a172ac43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:11.304906 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f2395a14-6edd-4385-b3b1-4972a172ac43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:11.306856 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f2395a14-6edd-4385-b3b1-4972a172ac43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:11.336010 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f2395a14-6edd-4385-b3b1-4972a172ac43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.789255 Aug 05 20:46:11.337032 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 117/240] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:10 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:11.343349 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-83e75589-7252-415a-9bb2-bad706cbd1e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:11.344463 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-83e75589-7252-415a-9bb2-bad706cbd1e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:11.354145 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83e75589-7252-415a-9bb2-bad706cbd1e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:11.354953 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83e75589-7252-415a-9bb2-bad706cbd1e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:11.355637 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83e75589-7252-415a-9bb2-bad706cbd1e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:11.356589 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83e75589-7252-415a-9bb2-bad706cbd1e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:11.357258 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83e75589-7252-415a-9bb2-bad706cbd1e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:11.358874 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83e75589-7252-415a-9bb2-bad706cbd1e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:11.398426 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:11.788827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b8453a02-0737-45fb-8ffc-03e0f70fa0f1 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:11.805286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b8453a02-0737-45fb-8ffc-03e0f70fa0f1 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1726 microversion: 2.1 time: 0.829646 Aug 05 20:46:11.828144 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 124/241] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:10 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1726 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:11.850273 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-25f99e7b-cb7b-43f2-94d9-da775a8c469d req-f39441b9-f197-4b5c-8a06-17375e295b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20537f07-e2b8-4c88-8757-58c0b37570d2", "name": "network-vif-plugged", "status": "completed", "tag": "a196cd1a-7fd3-4c91-8b4f-d500d0c2740a"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:11.882520 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-25f99e7b-cb7b-43f2-94d9-da775a8c469d req-f39441b9-f197-4b5c-8a06-17375e295b02 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:11.883714 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-25f99e7b-cb7b-43f2-94d9-da775a8c469d req-f39441b9-f197-4b5c-8a06-17375e295b02 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:11.884807 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-25f99e7b-cb7b-43f2-94d9-da775a8c469d req-f39441b9-f197-4b5c-8a06-17375e295b02 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:11.908187 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-25f99e7b-cb7b-43f2-94d9-da775a8c469d req-f39441b9-f197-4b5c-8a06-17375e295b02 service nova] Creating event network-vif-plugged:a196cd1a-7fd3-4c91-8b4f-d500d0c2740a for instance 20537f07-e2b8-4c88-8757-58c0b37570d2 on hv-cinder-85220 Aug 05 20:46:11.916698 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-25f99e7b-cb7b-43f2-94d9-da775a8c469d req-f39441b9-f197-4b5c-8a06-17375e295b02 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082227 Aug 05 20:46:11.920120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 125/242] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:46:11.929398 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b50efc7a-306a-4b9d-bc34-dc23c245ca07 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:11.930463 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b50efc7a-306a-4b9d-bc34-dc23c245ca07 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:11.940005 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-83e75589-7252-415a-9bb2-bad706cbd1e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:11.942137 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b50efc7a-306a-4b9d-bc34-dc23c245ca07 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:11.942967 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b50efc7a-306a-4b9d-bc34-dc23c245ca07 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:11.943804 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b50efc7a-306a-4b9d-bc34-dc23c245ca07 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:11.945484 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b50efc7a-306a-4b9d-bc34-dc23c245ca07 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:11.946860 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b50efc7a-306a-4b9d-bc34-dc23c245ca07 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:11.949019 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b50efc7a-306a-4b9d-bc34-dc23c245ca07 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:11.954018 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-83e75589-7252-415a-9bb2-bad706cbd1e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1521 microversion: 2.1 time: 0.615014 Aug 05 20:46:11.954835 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 118/243] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:11 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1521 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:11.975234 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f963ab93-89a3-449e-aabf-38dbef7ae044 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:11.979298 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f963ab93-89a3-449e-aabf-38dbef7ae044 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:11.991385 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f963ab93-89a3-449e-aabf-38dbef7ae044 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:11.991927 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f963ab93-89a3-449e-aabf-38dbef7ae044 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:11.992367 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f963ab93-89a3-449e-aabf-38dbef7ae044 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:11.993083 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f963ab93-89a3-449e-aabf-38dbef7ae044 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:11.993540 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f963ab93-89a3-449e-aabf-38dbef7ae044 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:11.993967 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f963ab93-89a3-449e-aabf-38dbef7ae044 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:12.156252 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b50efc7a-306a-4b9d-bc34-dc23c245ca07 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:12.176029 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b50efc7a-306a-4b9d-bc34-dc23c245ca07 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1303 microversion: 2.1 time: 0.253868 Aug 05 20:46:12.176922 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 126/244] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:11 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1303 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:12.197198 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c88c0775-eda3-4b75-a92d-52ff705c0030 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:12.210832 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c88c0775-eda3-4b75-a92d-52ff705c0030 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:12.238498 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c88c0775-eda3-4b75-a92d-52ff705c0030 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:12.247107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c88c0775-eda3-4b75-a92d-52ff705c0030 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:12.249255 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c88c0775-eda3-4b75-a92d-52ff705c0030 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:12.250337 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c88c0775-eda3-4b75-a92d-52ff705c0030 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:12.252154 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c88c0775-eda3-4b75-a92d-52ff705c0030 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:12.252768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c88c0775-eda3-4b75-a92d-52ff705c0030 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:12.321896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-c88c0775-eda3-4b75-a92d-52ff705c0030 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lazy-loading 'flavor' on Instance uuid 424981e0-db2d-449a-a636-3bb3b031f7da {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:46:12.551951 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c88c0775-eda3-4b75-a92d-52ff705c0030 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "POST /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da/action" status: 200 len: 32 microversion: 2.1 time: 0.355322 Aug 05 20:46:12.555028 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 127/245] 10.222.0.100 () {60 vars in 1283 bytes} [Fri Aug 5 20:46:12 2022] POST /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da/action => generated 32 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:46:12.589277 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6415b656-5964-45be-9526-3d0bfe43e9b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:12.595390 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6415b656-5964-45be-9526-3d0bfe43e9b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:12.610759 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6415b656-5964-45be-9526-3d0bfe43e9b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:12.617243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6415b656-5964-45be-9526-3d0bfe43e9b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:12.617743 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6415b656-5964-45be-9526-3d0bfe43e9b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:12.618518 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6415b656-5964-45be-9526-3d0bfe43e9b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:12.620283 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6415b656-5964-45be-9526-3d0bfe43e9b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:12.620821 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6415b656-5964-45be-9526-3d0bfe43e9b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:12.663945 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:12.800173 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:12.881737 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=10 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:13.274415 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6415b656-5964-45be-9526-3d0bfe43e9b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:13.283866 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6415b656-5964-45be-9526-3d0bfe43e9b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:13.292369 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6415b656-5964-45be-9526-3d0bfe43e9b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:13.293607 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6415b656-5964-45be-9526-3d0bfe43e9b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.730852 Aug 05 20:46:13.297603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 128/246] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:12 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:13.302479 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ac86100c-4eb0-4627-919d-1d63de39ab87 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:13.303090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ac86100c-4eb0-4627-919d-1d63de39ab87 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:13.305020 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:13.310724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac86100c-4eb0-4627-919d-1d63de39ab87 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:13.311218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac86100c-4eb0-4627-919d-1d63de39ab87 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:13.311834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac86100c-4eb0-4627-919d-1d63de39ab87 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:13.312787 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac86100c-4eb0-4627-919d-1d63de39ab87 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:13.313239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac86100c-4eb0-4627-919d-1d63de39ab87 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:13.313662 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac86100c-4eb0-4627-919d-1d63de39ab87 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:13.508229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f963ab93-89a3-449e-aabf-38dbef7ae044 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:13.524546 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f963ab93-89a3-449e-aabf-38dbef7ae044 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1318 microversion: 2.1 time: 1.562112 Aug 05 20:46:13.553175 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 119/247] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:11 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1318 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:13.571582 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-46213b8d-ac6a-4c64-8927-6453b5f26647 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:13.574136 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-46213b8d-ac6a-4c64-8927-6453b5f26647 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:13.597217 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-46213b8d-ac6a-4c64-8927-6453b5f26647 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:13.605891 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-46213b8d-ac6a-4c64-8927-6453b5f26647 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:13.614214 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-46213b8d-ac6a-4c64-8927-6453b5f26647 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:13.616641 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-46213b8d-ac6a-4c64-8927-6453b5f26647 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:13.619895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-46213b8d-ac6a-4c64-8927-6453b5f26647 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:13.625033 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-46213b8d-ac6a-4c64-8927-6453b5f26647 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:14.054469 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:14.399115 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-46213b8d-ac6a-4c64-8927-6453b5f26647 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:14.409944 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-46213b8d-ac6a-4c64-8927-6453b5f26647 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1726 microversion: 2.1 time: 0.855289 Aug 05 20:46:14.416406 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 120/248] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:13 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1726 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:14.428969 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-2b38da77-e0bb-4434-9ddb-8c5e905a5718 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:14.429918 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-2b38da77-e0bb-4434-9ddb-8c5e905a5718 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:14.442360 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2b38da77-e0bb-4434-9ddb-8c5e905a5718 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:14.442841 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2b38da77-e0bb-4434-9ddb-8c5e905a5718 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:14.446323 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2b38da77-e0bb-4434-9ddb-8c5e905a5718 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:14.447050 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2b38da77-e0bb-4434-9ddb-8c5e905a5718 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:14.451602 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2b38da77-e0bb-4434-9ddb-8c5e905a5718 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:14.452669 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2b38da77-e0bb-4434-9ddb-8c5e905a5718 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:14.610249 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ac86100c-4eb0-4627-919d-1d63de39ab87 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:14.618473 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ac86100c-4eb0-4627-919d-1d63de39ab87 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 1.319933 Aug 05 20:46:14.619083 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 129/249] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:13 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:14.640074 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-c2aff72a-2051-4145-b74c-bcb169dd70c2 req-42697261-7701-4fa1-87ae-4a251ea3218f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ef44444-a6d8-49fd-8e77-0a9bb347fd1a", "tag": "796128a9-b6c9-4059-b594-b45eebcaa851"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:14.656335 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-c2aff72a-2051-4145-b74c-bcb169dd70c2 req-42697261-7701-4fa1-87ae-4a251ea3218f service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:14.657029 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-c2aff72a-2051-4145-b74c-bcb169dd70c2 req-42697261-7701-4fa1-87ae-4a251ea3218f service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:14.657474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-c2aff72a-2051-4145-b74c-bcb169dd70c2 req-42697261-7701-4fa1-87ae-4a251ea3218f service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:14.672892 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-c2aff72a-2051-4145-b74c-bcb169dd70c2 req-42697261-7701-4fa1-87ae-4a251ea3218f service nova] Creating event network-changed:796128a9-b6c9-4059-b594-b45eebcaa851 for instance 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a on hv-cinder-85220 Aug 05 20:46:14.678292 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-c2aff72a-2051-4145-b74c-bcb169dd70c2 req-42697261-7701-4fa1-87ae-4a251ea3218f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057960 Aug 05 20:46:14.679649 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 130/250] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:46:14.685526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-21709906-59ac-40a0-adb1-4bb2d4bc0de9 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:14.686575 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-21709906-59ac-40a0-adb1-4bb2d4bc0de9 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:14.694463 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-21709906-59ac-40a0-adb1-4bb2d4bc0de9 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:14.695341 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-21709906-59ac-40a0-adb1-4bb2d4bc0de9 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:14.696138 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-21709906-59ac-40a0-adb1-4bb2d4bc0de9 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:14.697209 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-21709906-59ac-40a0-adb1-4bb2d4bc0de9 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:14.697989 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-21709906-59ac-40a0-adb1-4bb2d4bc0de9 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:14.698615 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-21709906-59ac-40a0-adb1-4bb2d4bc0de9 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:14.992261 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=8 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:15.323110 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2b38da77-e0bb-4434-9ddb-8c5e905a5718 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:15.340273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-2b38da77-e0bb-4434-9ddb-8c5e905a5718 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 0.920264 Aug 05 20:46:15.341883 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 121/251] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:14 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:15.360170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-885c5ea5-24f8-45bb-b29c-1641f40e5cce tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:15.362590 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-885c5ea5-24f8-45bb-b29c-1641f40e5cce tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:15.367745 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:15.373745 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-885c5ea5-24f8-45bb-b29c-1641f40e5cce tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:15.374252 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-885c5ea5-24f8-45bb-b29c-1641f40e5cce tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:15.379302 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-885c5ea5-24f8-45bb-b29c-1641f40e5cce tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:15.380984 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-885c5ea5-24f8-45bb-b29c-1641f40e5cce tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:15.381471 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-885c5ea5-24f8-45bb-b29c-1641f40e5cce tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:15.381923 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-885c5ea5-24f8-45bb-b29c-1641f40e5cce tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:15.459551 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-21709906-59ac-40a0-adb1-4bb2d4bc0de9 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:15.471143 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-21709906-59ac-40a0-adb1-4bb2d4bc0de9 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:15.473502 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-21709906-59ac-40a0-adb1-4bb2d4bc0de9 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:15.480154 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-21709906-59ac-40a0-adb1-4bb2d4bc0de9 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.798594 Aug 05 20:46:15.483201 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 131/252] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:14 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:15.503476 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3dd031f4-4ea2-4c30-af51-d5d92709987b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Action: 'create', calling method: .version_select at 0x7f9bec0d39d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1345926642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARP9dD+wzlVwSi66XUXRc1HhEpNiNYIlpuWLMdgbj2OirufrkaJToOqRxUzTZxLe8pPB6HqZaFZkt2NAc78sApmUS6vcg7oa1dcEQ13y0v87HocoJkaokyZ8sLsxcVisw=="}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:15.558707 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-3dd031f4-4ea2-4c30-af51-d5d92709987b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Getting quotas for project 958a479cb6904c1bb6e6868c2b061e02. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:46:15.558707 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-3dd031f4-4ea2-4c30-af51-d5d92709987b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Getting quotas for user 30986eb76c6d4434b9c92f26d8418fbb and project 958a479cb6904c1bb6e6868c2b061e02. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:46:15.575673 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3dd031f4-4ea2-4c30-af51-d5d92709987b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.076648 Aug 05 20:46:15.589187 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 132/253] 10.222.0.100 () {60 vars in 1164 bytes} [Fri Aug 5 20:46:15 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:46:15.589187 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-97ccb074-63dc-4a9d-ab25-094189402b2b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:15.589187 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-97ccb074-63dc-4a9d-ab25-094189402b2b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:15.593590 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97ccb074-63dc-4a9d-ab25-094189402b2b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:15.594472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97ccb074-63dc-4a9d-ab25-094189402b2b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:15.595024 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97ccb074-63dc-4a9d-ab25-094189402b2b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:15.596827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97ccb074-63dc-4a9d-ab25-094189402b2b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:15.597738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97ccb074-63dc-4a9d-ab25-094189402b2b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:15.598278 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97ccb074-63dc-4a9d-ab25-094189402b2b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:16.199636 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-885c5ea5-24f8-45bb-b29c-1641f40e5cce tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:16.235602 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-885c5ea5-24f8-45bb-b29c-1641f40e5cce tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1318 microversion: 2.1 time: 0.883957 Aug 05 20:46:16.237315 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 122/254] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:15 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1318 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:16.245345 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c6801a9d-3aeb-4d87-b214-edcf5b68655e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:16.248940 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c6801a9d-3aeb-4d87-b214-edcf5b68655e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:16.265122 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c6801a9d-3aeb-4d87-b214-edcf5b68655e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:16.270630 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c6801a9d-3aeb-4d87-b214-edcf5b68655e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:16.271305 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c6801a9d-3aeb-4d87-b214-edcf5b68655e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:16.272350 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c6801a9d-3aeb-4d87-b214-edcf5b68655e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:16.273019 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c6801a9d-3aeb-4d87-b214-edcf5b68655e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:16.273729 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c6801a9d-3aeb-4d87-b214-edcf5b68655e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:16.481810 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-97ccb074-63dc-4a9d-ab25-094189402b2b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:16.493796 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-97ccb074-63dc-4a9d-ab25-094189402b2b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1726 microversion: 2.1 time: 0.914922 Aug 05 20:46:16.495479 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 133/255] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:15 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1726 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:16.504919 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-492786005", "imageRef": "332a2f40-7f48-4c08-aba7-097b585d2ed0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1345926642", "networks": [{"uuid": "116d75df-1b35-46c9-83df-f3ccabef1e14"}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:16.597673 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] validate_networks() for [('116d75df-1b35-46c9-83df-f3ccabef1e14', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:46:16.633003 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c6801a9d-3aeb-4d87-b214-edcf5b68655e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:16.640725 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c6801a9d-3aeb-4d87-b214-edcf5b68655e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.401853 Aug 05 20:46:16.654322 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 123/256] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:16 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:16.660590 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-83b8821a-0a4c-4680-8625-e11f9cbad39d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:16.661207 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-83b8821a-0a4c-4680-8625-e11f9cbad39d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:16.667727 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83b8821a-0a4c-4680-8625-e11f9cbad39d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:16.668423 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83b8821a-0a4c-4680-8625-e11f9cbad39d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:16.669039 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83b8821a-0a4c-4680-8625-e11f9cbad39d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:16.669925 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83b8821a-0a4c-4680-8625-e11f9cbad39d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:16.670698 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83b8821a-0a4c-4680-8625-e11f9cbad39d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:16.671261 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83b8821a-0a4c-4680-8625-e11f9cbad39d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:17.093266 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-83b8821a-0a4c-4680-8625-e11f9cbad39d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:17.102421 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-83b8821a-0a4c-4680-8625-e11f9cbad39d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 0.446226 Aug 05 20:46:17.104061 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 124/257] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:16 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:17.110299 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-624fb1cb-f247-4653-917a-65705063051c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:17.111332 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-624fb1cb-f247-4653-917a-65705063051c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:17.118886 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-624fb1cb-f247-4653-917a-65705063051c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:17.119824 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-624fb1cb-f247-4653-917a-65705063051c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:17.120443 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-624fb1cb-f247-4653-917a-65705063051c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:17.121311 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-624fb1cb-f247-4653-917a-65705063051c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:17.121919 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-624fb1cb-f247-4653-917a-65705063051c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:17.122498 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-624fb1cb-f247-4653-917a-65705063051c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:17.665117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-624fb1cb-f247-4653-917a-65705063051c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:17.679815 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-624fb1cb-f247-4653-917a-65705063051c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:17.684713 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-624fb1cb-f247-4653-917a-65705063051c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:17.692077 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-624fb1cb-f247-4653-917a-65705063051c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.581656 Aug 05 20:46:17.694098 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 125/258] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:17 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:17.700069 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-b10062ee-c1db-4e3a-8f18-090abc048115 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:17.701720 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-b10062ee-c1db-4e3a-8f18-090abc048115 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:17.708954 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b10062ee-c1db-4e3a-8f18-090abc048115 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:17.709696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b10062ee-c1db-4e3a-8f18-090abc048115 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:17.710311 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b10062ee-c1db-4e3a-8f18-090abc048115 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:17.712459 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b10062ee-c1db-4e3a-8f18-090abc048115 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:17.713139 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b10062ee-c1db-4e3a-8f18-090abc048115 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:17.713727 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b10062ee-c1db-4e3a-8f18-090abc048115 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:18.075047 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:46:18.075671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:46:18.076434 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:46:18.077655 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:46:18.079894 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:46:18.096550 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:18.098042 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:18.098701 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:18.100348 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:18.101934 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:18.102669 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:18.132662 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Getting quotas for project 958a479cb6904c1bb6e6868c2b061e02. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:46:18.134921 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-b10062ee-c1db-4e3a-8f18-090abc048115 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:18.140700 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Getting quotas for user 30986eb76c6d4434b9c92f26d8418fbb and project 958a479cb6904c1bb6e6868c2b061e02. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:46:18.143846 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-b10062ee-c1db-4e3a-8f18-090abc048115 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1318 microversion: 2.1 time: 0.448141 Aug 05 20:46:18.148802 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 126/259] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:17 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:18.168581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:46:18.171637 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='332a2f40-7f48-4c08-aba7-097b585d2ed0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:46:18.247940 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1f927b6f-a31a-47a6-a032-ac1f77f57a0a tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.750906 Aug 05 20:46:18.249469 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 134/260] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:46:16 2022] POST /compute/v2.1/servers => generated 382 bytes in 1753 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:46:18.256051 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-951c4c60-2da1-4e5c-b033-db95bd923b04 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:18.256863 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-951c4c60-2da1-4e5c-b033-db95bd923b04 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:18.264161 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951c4c60-2da1-4e5c-b033-db95bd923b04 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:18.264929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951c4c60-2da1-4e5c-b033-db95bd923b04 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:18.265547 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951c4c60-2da1-4e5c-b033-db95bd923b04 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:18.267324 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951c4c60-2da1-4e5c-b033-db95bd923b04 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:18.268535 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951c4c60-2da1-4e5c-b033-db95bd923b04 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:18.269544 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951c4c60-2da1-4e5c-b033-db95bd923b04 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:18.539040 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ad41eb8c-7835-44ed-983c-6b676e174313 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Action: 'create', calling method: .version_select at 0x7f9bec342f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-31510839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7rm29Bq1aI3TRc1b0vBvP9qCvLiQ93eSHdRZFdrOYsXiWI1uDcxwceutp1yDEupFMnIF5K/1vJ8KIwM5tM52GkJfYC/mp2MQEQMzsRJC10dXdSWr2lru8V6Ha8Y769RQ=="}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:18.572811 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-ad41eb8c-7835-44ed-983c-6b676e174313 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Getting quotas for project 14277b321e0043f9a0846cc4949465c7. Resources: {'key_pairs'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:46:18.582045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-ad41eb8c-7835-44ed-983c-6b676e174313 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Getting quotas for user 9808a95e377143e2a77547c14e7932a4 and project 14277b321e0043f9a0846cc4949465c7. Resources: {'key_pairs'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:46:18.631729 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ad41eb8c-7835-44ed-983c-6b676e174313 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.481266 Aug 05 20:46:18.632964 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 127/261] 10.222.0.100 () {60 vars in 1164 bytes} [Fri Aug 5 20:46:18 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:46:18.660724 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-80a4ec14-a216-4879-8725-3b3003b285e8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:18.664178 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-80a4ec14-a216-4879-8725-3b3003b285e8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:18.688635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-80a4ec14-a216-4879-8725-3b3003b285e8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:18.689324 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-80a4ec14-a216-4879-8725-3b3003b285e8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:18.689739 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-80a4ec14-a216-4879-8725-3b3003b285e8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:18.690793 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-80a4ec14-a216-4879-8725-3b3003b285e8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:18.691544 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-80a4ec14-a216-4879-8725-3b3003b285e8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:18.692584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-80a4ec14-a216-4879-8725-3b3003b285e8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:19.170806 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-951c4c60-2da1-4e5c-b033-db95bd923b04 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:19.198449 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-951c4c60-2da1-4e5c-b033-db95bd923b04 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1726 microversion: 2.1 time: 0.947495 Aug 05 20:46:19.201686 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 135/262] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:18 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1726 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:19.215165 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5921f3bf-0ab6-48a7-aec4-25c139f1a308 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:19.219047 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5921f3bf-0ab6-48a7-aec4-25c139f1a308 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:19.233893 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5921f3bf-0ab6-48a7-aec4-25c139f1a308 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:19.235450 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5921f3bf-0ab6-48a7-aec4-25c139f1a308 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:19.238151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5921f3bf-0ab6-48a7-aec4-25c139f1a308 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:19.240711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5921f3bf-0ab6-48a7-aec4-25c139f1a308 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:19.242585 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5921f3bf-0ab6-48a7-aec4-25c139f1a308 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:19.243700 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5921f3bf-0ab6-48a7-aec4-25c139f1a308 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:19.301056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-80a4ec14-a216-4879-8725-3b3003b285e8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:19.321198 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-80a4ec14-a216-4879-8725-3b3003b285e8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.669202 Aug 05 20:46:19.322013 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 128/263] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:18 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:19.348102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3e32c262-9af3-44e9-9622-3aee30321abe tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:19.350696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3e32c262-9af3-44e9-9622-3aee30321abe tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:19.590313 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3e32c262-9af3-44e9-9622-3aee30321abe tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:19.601715 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3e32c262-9af3-44e9-9622-3aee30321abe tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1262 microversion: 2.1 time: 0.263988 Aug 05 20:46:19.613342 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 129/264] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:19 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1262 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:19.620643 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-97f30b35-98e0-4e24-9502-58954abaf043 req-1f97e904-fd37-4fdf-9190-c114e226e84b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784e7d44-0869-48e1-84f5-e35567f73947", "tag": "71f59c3d-04cf-4aa9-981a-c0db0c85c972"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:19.631834 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-97f30b35-98e0-4e24-9502-58954abaf043 req-1f97e904-fd37-4fdf-9190-c114e226e84b service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:19.632325 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-97f30b35-98e0-4e24-9502-58954abaf043 req-1f97e904-fd37-4fdf-9190-c114e226e84b service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:19.632757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-97f30b35-98e0-4e24-9502-58954abaf043 req-1f97e904-fd37-4fdf-9190-c114e226e84b service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:19.644882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-97f30b35-98e0-4e24-9502-58954abaf043 req-1f97e904-fd37-4fdf-9190-c114e226e84b service nova] Creating event network-changed:71f59c3d-04cf-4aa9-981a-c0db0c85c972 for instance 784e7d44-0869-48e1-84f5-e35567f73947 on hv-cinder-85220 Aug 05 20:46:19.649947 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-97f30b35-98e0-4e24-9502-58954abaf043 req-1f97e904-fd37-4fdf-9190-c114e226e84b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035249 Aug 05 20:46:19.650948 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 130/265] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:46:19.656636 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4087557f-281d-4207-8dce-818676b9865e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:19.657343 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4087557f-281d-4207-8dce-818676b9865e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:19.671181 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4087557f-281d-4207-8dce-818676b9865e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:19.671711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4087557f-281d-4207-8dce-818676b9865e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:19.672152 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4087557f-281d-4207-8dce-818676b9865e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:19.672871 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4087557f-281d-4207-8dce-818676b9865e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:19.673330 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4087557f-281d-4207-8dce-818676b9865e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:19.673763 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4087557f-281d-4207-8dce-818676b9865e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:20.191698 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5921f3bf-0ab6-48a7-aec4-25c139f1a308 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:20.209193 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5921f3bf-0ab6-48a7-aec4-25c139f1a308 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 1.005694 Aug 05 20:46:20.210941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 136/266] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:19 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:20.222943 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1fdb84da-07a5-4eae-a05a-125b3e4002a3 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:20.225336 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1fdb84da-07a5-4eae-a05a-125b3e4002a3 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:20.241217 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1fdb84da-07a5-4eae-a05a-125b3e4002a3 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:20.247126 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1fdb84da-07a5-4eae-a05a-125b3e4002a3 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:20.248583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1fdb84da-07a5-4eae-a05a-125b3e4002a3 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:20.255140 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1fdb84da-07a5-4eae-a05a-125b3e4002a3 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:20.256301 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1fdb84da-07a5-4eae-a05a-125b3e4002a3 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:20.256902 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1fdb84da-07a5-4eae-a05a-125b3e4002a3 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:20.441562 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4087557f-281d-4207-8dce-818676b9865e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:20.453204 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4087557f-281d-4207-8dce-818676b9865e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:20.460130 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4087557f-281d-4207-8dce-818676b9865e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:20.461941 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4087557f-281d-4207-8dce-818676b9865e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.809766 Aug 05 20:46:20.463085 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 131/267] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:19 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:20.470400 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ba8fc367-431e-47d0-b337-29f6e8238d96 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:20.471352 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ba8fc367-431e-47d0-b337-29f6e8238d96 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:20.479812 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ba8fc367-431e-47d0-b337-29f6e8238d96 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:20.480544 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ba8fc367-431e-47d0-b337-29f6e8238d96 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:20.481136 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ba8fc367-431e-47d0-b337-29f6e8238d96 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:20.485885 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ba8fc367-431e-47d0-b337-29f6e8238d96 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:20.486806 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ba8fc367-431e-47d0-b337-29f6e8238d96 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:20.487610 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ba8fc367-431e-47d0-b337-29f6e8238d96 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:21.445934 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1fdb84da-07a5-4eae-a05a-125b3e4002a3 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:21.460157 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1fdb84da-07a5-4eae-a05a-125b3e4002a3 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1318 microversion: 2.1 time: 1.246279 Aug 05 20:46:21.461391 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 137/268] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:20 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1318 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:21.467813 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-87304a1c-e444-4e31-8bad-2d3b7b64e33c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:21.468890 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-87304a1c-e444-4e31-8bad-2d3b7b64e33c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:21.477016 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-87304a1c-e444-4e31-8bad-2d3b7b64e33c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:21.478671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-87304a1c-e444-4e31-8bad-2d3b7b64e33c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:21.479264 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-87304a1c-e444-4e31-8bad-2d3b7b64e33c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:21.480247 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-87304a1c-e444-4e31-8bad-2d3b7b64e33c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:21.480927 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-87304a1c-e444-4e31-8bad-2d3b7b64e33c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:21.481593 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-87304a1c-e444-4e31-8bad-2d3b7b64e33c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:21.516072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ba8fc367-431e-47d0-b337-29f6e8238d96 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:21.527960 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ba8fc367-431e-47d0-b337-29f6e8238d96 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1726 microversion: 2.1 time: 1.063568 Aug 05 20:46:21.536261 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 132/269] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:20 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1726 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:21.551174 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f4fceb2b-c24f-40e8-822e-5d680950c34d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:21.551833 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f4fceb2b-c24f-40e8-822e-5d680950c34d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:21.558711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4fceb2b-c24f-40e8-822e-5d680950c34d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:21.559206 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4fceb2b-c24f-40e8-822e-5d680950c34d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:21.559668 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4fceb2b-c24f-40e8-822e-5d680950c34d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:21.560366 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4fceb2b-c24f-40e8-822e-5d680950c34d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:21.560824 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4fceb2b-c24f-40e8-822e-5d680950c34d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:21.561249 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4fceb2b-c24f-40e8-822e-5d680950c34d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:21.683420 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f4fceb2b-c24f-40e8-822e-5d680950c34d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:21.695061 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f4fceb2b-c24f-40e8-822e-5d680950c34d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1320 microversion: 2.1 time: 0.157407 Aug 05 20:46:21.714030 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 133/270] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:21 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1320 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:21.726994 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-fcfc14cd-12b1-4816-9a66-08528969d66e req-81568502-b52a-4ec3-a591-8cadd662a573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef44444-a6d8-49fd-8e77-0a9bb347fd1a", "name": "network-vif-plugged", "status": "completed", "tag": "796128a9-b6c9-4059-b594-b45eebcaa851"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:21.782004 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-fcfc14cd-12b1-4816-9a66-08528969d66e req-81568502-b52a-4ec3-a591-8cadd662a573 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:21.782760 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-fcfc14cd-12b1-4816-9a66-08528969d66e req-81568502-b52a-4ec3-a591-8cadd662a573 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:21.783351 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-fcfc14cd-12b1-4816-9a66-08528969d66e req-81568502-b52a-4ec3-a591-8cadd662a573 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:21.791385 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-87304a1c-e444-4e31-8bad-2d3b7b64e33c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:21.803709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-87304a1c-e444-4e31-8bad-2d3b7b64e33c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.340773 Aug 05 20:46:21.804246 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 138/271] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:21 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:21.825543 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1eaa18fb-046b-470f-a90a-b64b8821fe12 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:21.826358 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1eaa18fb-046b-470f-a90a-b64b8821fe12 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:21.833012 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1eaa18fb-046b-470f-a90a-b64b8821fe12 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:21.833516 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1eaa18fb-046b-470f-a90a-b64b8821fe12 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:21.833956 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1eaa18fb-046b-470f-a90a-b64b8821fe12 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:21.834831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1eaa18fb-046b-470f-a90a-b64b8821fe12 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:21.835292 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1eaa18fb-046b-470f-a90a-b64b8821fe12 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:21.835423 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-fcfc14cd-12b1-4816-9a66-08528969d66e req-81568502-b52a-4ec3-a591-8cadd662a573 service nova] Creating event network-vif-plugged:796128a9-b6c9-4059-b594-b45eebcaa851 for instance 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a on hv-cinder-85220 Aug 05 20:46:21.835746 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1eaa18fb-046b-470f-a90a-b64b8821fe12 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:21.846247 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-fcfc14cd-12b1-4816-9a66-08528969d66e req-81568502-b52a-4ec3-a591-8cadd662a573 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130563 Aug 05 20:46:21.852262 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 134/272] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:46:21.868576 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-53fe6c7b-760f-4f9c-81be-1187cdaf86d3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:21.869269 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-53fe6c7b-760f-4f9c-81be-1187cdaf86d3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:21.887351 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-53fe6c7b-760f-4f9c-81be-1187cdaf86d3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:21.888217 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-53fe6c7b-760f-4f9c-81be-1187cdaf86d3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:21.888903 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-53fe6c7b-760f-4f9c-81be-1187cdaf86d3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:21.890071 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-53fe6c7b-760f-4f9c-81be-1187cdaf86d3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:21.890675 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-53fe6c7b-760f-4f9c-81be-1187cdaf86d3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:21.891485 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-53fe6c7b-760f-4f9c-81be-1187cdaf86d3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:22.090690 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1eaa18fb-046b-470f-a90a-b64b8821fe12 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:22.099268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1eaa18fb-046b-470f-a90a-b64b8821fe12 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 0.278032 Aug 05 20:46:22.102091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 139/273] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:21 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:22.114644 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-53fe6c7b-760f-4f9c-81be-1187cdaf86d3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:22.123542 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-53fe6c7b-760f-4f9c-81be-1187cdaf86d3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:22.125421 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-53fe6c7b-760f-4f9c-81be-1187cdaf86d3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:22.126638 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-53fe6c7b-760f-4f9c-81be-1187cdaf86d3 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.273416 Aug 05 20:46:22.127204 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 135/274] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:21 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:22.489025 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-175dcdb2-889a-403c-b03e-349b12a86e41 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:22.490585 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-175dcdb2-889a-403c-b03e-349b12a86e41 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:22.497127 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-175dcdb2-889a-403c-b03e-349b12a86e41 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:22.497926 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-175dcdb2-889a-403c-b03e-349b12a86e41 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:22.498576 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-175dcdb2-889a-403c-b03e-349b12a86e41 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:22.499508 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-175dcdb2-889a-403c-b03e-349b12a86e41 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:22.500181 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-175dcdb2-889a-403c-b03e-349b12a86e41 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:22.500798 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-175dcdb2-889a-403c-b03e-349b12a86e41 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:22.566008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c2b9b774-b772-4d0a-95cf-e6ca20dbf1fc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:22.567806 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c2b9b774-b772-4d0a-95cf-e6ca20dbf1fc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:22.587552 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2b9b774-b772-4d0a-95cf-e6ca20dbf1fc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:22.588370 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2b9b774-b772-4d0a-95cf-e6ca20dbf1fc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:22.589000 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2b9b774-b772-4d0a-95cf-e6ca20dbf1fc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:22.589905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2b9b774-b772-4d0a-95cf-e6ca20dbf1fc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:22.590518 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2b9b774-b772-4d0a-95cf-e6ca20dbf1fc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:22.591101 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2b9b774-b772-4d0a-95cf-e6ca20dbf1fc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:22.745104 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-175dcdb2-889a-403c-b03e-349b12a86e41 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:22.756985 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-175dcdb2-889a-403c-b03e-349b12a86e41 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1318 microversion: 2.1 time: 0.272617 Aug 05 20:46:22.773609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 140/275] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:22 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:22.779213 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4fa5b1a8-2370-417c-9818-db9b9f9415ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:22.780461 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4fa5b1a8-2370-417c-9818-db9b9f9415ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:22.789139 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4fa5b1a8-2370-417c-9818-db9b9f9415ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:22.789927 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4fa5b1a8-2370-417c-9818-db9b9f9415ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:22.792977 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c2b9b774-b772-4d0a-95cf-e6ca20dbf1fc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:22.794060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4fa5b1a8-2370-417c-9818-db9b9f9415ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:22.795868 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4fa5b1a8-2370-417c-9818-db9b9f9415ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:22.797391 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4fa5b1a8-2370-417c-9818-db9b9f9415ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:22.798234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4fa5b1a8-2370-417c-9818-db9b9f9415ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:22.803483 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c2b9b774-b772-4d0a-95cf-e6ca20dbf1fc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1703 microversion: 2.1 time: 0.248627 Aug 05 20:46:22.819599 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 136/276] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:22 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1703 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:22.829251 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f573163d-939a-49dd-819b-0b09e10d7bb1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:22.831041 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f573163d-939a-49dd-819b-0b09e10d7bb1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:22.859125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f573163d-939a-49dd-819b-0b09e10d7bb1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:22.864106 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f573163d-939a-49dd-819b-0b09e10d7bb1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:22.864978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f573163d-939a-49dd-819b-0b09e10d7bb1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:22.867743 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f573163d-939a-49dd-819b-0b09e10d7bb1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:22.868464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f573163d-939a-49dd-819b-0b09e10d7bb1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:22.870114 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f573163d-939a-49dd-819b-0b09e10d7bb1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:22.905976 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4fa5b1a8-2370-417c-9818-db9b9f9415ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:22.926737 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4fa5b1a8-2370-417c-9818-db9b9f9415ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1320 microversion: 2.1 time: 0.151640 Aug 05 20:46:22.928532 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 141/277] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:22 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:22.933914 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-90a93f2d-1e8e-4664-8c06-05ffc12b82a3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:22.941675 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-90a93f2d-1e8e-4664-8c06-05ffc12b82a3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:22.942422 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-90a93f2d-1e8e-4664-8c06-05ffc12b82a3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:22.943011 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-90a93f2d-1e8e-4664-8c06-05ffc12b82a3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:23.077778 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-90a93f2d-1e8e-4664-8c06-05ffc12b82a3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Going to try to start instance {{(pid=124432) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 20:46:23.176654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-90a93f2d-1e8e-4664-8c06-05ffc12b82a3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "POST /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/action" status: 202 len: 0 microversion: 2.1 time: 0.246502 Aug 05 20:46:23.177321 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 142/278] 10.222.0.100 () {60 vars in 1283 bytes} [Fri Aug 5 20:46:22 2022] POST /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:46:23.182570 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9b367f8f-7410-4a98-a971-687cd9efdb08 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:23.187616 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9b367f8f-7410-4a98-a971-687cd9efdb08 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:23.208277 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9b367f8f-7410-4a98-a971-687cd9efdb08 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:23.209056 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9b367f8f-7410-4a98-a971-687cd9efdb08 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:23.209645 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9b367f8f-7410-4a98-a971-687cd9efdb08 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:23.210566 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9b367f8f-7410-4a98-a971-687cd9efdb08 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:23.211323 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9b367f8f-7410-4a98-a971-687cd9efdb08 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:23.211975 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9b367f8f-7410-4a98-a971-687cd9efdb08 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:23.390658 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f573163d-939a-49dd-819b-0b09e10d7bb1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:23.402638 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f573163d-939a-49dd-819b-0b09e10d7bb1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.580029 Aug 05 20:46:23.404912 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 137/279] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:22 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:23.410351 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0b5e7257-b15b-4867-801c-7040538f9f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:23.421524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0b5e7257-b15b-4867-801c-7040538f9f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:23.443667 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b5e7257-b15b-4867-801c-7040538f9f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:23.444584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b5e7257-b15b-4867-801c-7040538f9f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:23.445219 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b5e7257-b15b-4867-801c-7040538f9f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:23.446134 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b5e7257-b15b-4867-801c-7040538f9f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:23.446797 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b5e7257-b15b-4867-801c-7040538f9f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:23.447512 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b5e7257-b15b-4867-801c-7040538f9f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:23.503347 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=100 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:24.002924 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9b367f8f-7410-4a98-a971-687cd9efdb08 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:24.002924 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9b367f8f-7410-4a98-a971-687cd9efdb08 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 0.820331 Aug 05 20:46:24.019523 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 143/280] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:23 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:24.028024 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-804bbd93-3ec4-4239-9dad-62afd9200fdc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:24.035870 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-804bbd93-3ec4-4239-9dad-62afd9200fdc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:24.052783 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-804bbd93-3ec4-4239-9dad-62afd9200fdc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:24.054065 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-804bbd93-3ec4-4239-9dad-62afd9200fdc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:24.055171 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-804bbd93-3ec4-4239-9dad-62afd9200fdc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:24.056898 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-804bbd93-3ec4-4239-9dad-62afd9200fdc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:24.058567 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-804bbd93-3ec4-4239-9dad-62afd9200fdc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:24.059729 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-804bbd93-3ec4-4239-9dad-62afd9200fdc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:24.196207 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0b5e7257-b15b-4867-801c-7040538f9f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:24.220467 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0b5e7257-b15b-4867-801c-7040538f9f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:24.222407 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0b5e7257-b15b-4867-801c-7040538f9f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:24.229012 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0b5e7257-b15b-4867-801c-7040538f9f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.822479 Aug 05 20:46:24.230377 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 138/281] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:23 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:24.235161 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f983aef0-88c0-4886-9179-cbce219a0469 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:24.240344 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f983aef0-88c0-4886-9179-cbce219a0469 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:24.262845 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f983aef0-88c0-4886-9179-cbce219a0469 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:24.265426 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f983aef0-88c0-4886-9179-cbce219a0469 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:24.268052 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f983aef0-88c0-4886-9179-cbce219a0469 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:24.271445 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f983aef0-88c0-4886-9179-cbce219a0469 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:24.274139 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f983aef0-88c0-4886-9179-cbce219a0469 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:24.276332 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f983aef0-88c0-4886-9179-cbce219a0469 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:24.488573 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-804bbd93-3ec4-4239-9dad-62afd9200fdc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:24.505135 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-804bbd93-3ec4-4239-9dad-62afd9200fdc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1712 microversion: 2.1 time: 0.484522 Aug 05 20:46:24.505744 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 144/282] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:24 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1712 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:24.524857 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-193dac6c-e001-4cbb-8645-740351cb816d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:24.525485 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-193dac6c-e001-4cbb-8645-740351cb816d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:24.539294 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-193dac6c-e001-4cbb-8645-740351cb816d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:24.540367 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-193dac6c-e001-4cbb-8645-740351cb816d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:24.542250 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-193dac6c-e001-4cbb-8645-740351cb816d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:24.543173 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-193dac6c-e001-4cbb-8645-740351cb816d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:24.543860 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-193dac6c-e001-4cbb-8645-740351cb816d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:24.544437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-193dac6c-e001-4cbb-8645-740351cb816d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:24.657362 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-193dac6c-e001-4cbb-8645-740351cb816d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:24.666445 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-193dac6c-e001-4cbb-8645-740351cb816d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1320 microversion: 2.1 time: 0.145502 Aug 05 20:46:24.671793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 145/283] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:24 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1320 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:24.684849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2c6ac94c-3a75-4de1-a435-c3f739d0ed2f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:24.685478 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2c6ac94c-3a75-4de1-a435-c3f739d0ed2f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:24.692830 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c6ac94c-3a75-4de1-a435-c3f739d0ed2f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:24.693250 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c6ac94c-3a75-4de1-a435-c3f739d0ed2f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:24.693686 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c6ac94c-3a75-4de1-a435-c3f739d0ed2f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:24.694430 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c6ac94c-3a75-4de1-a435-c3f739d0ed2f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:24.694878 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c6ac94c-3a75-4de1-a435-c3f739d0ed2f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:24.695294 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c6ac94c-3a75-4de1-a435-c3f739d0ed2f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:24.715842 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f983aef0-88c0-4886-9179-cbce219a0469 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:24.719217 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:24.734514 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f983aef0-88c0-4886-9179-cbce219a0469 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1318 microversion: 2.1 time: 0.502783 Aug 05 20:46:24.737022 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 139/284] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:24 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:25.032555 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-becf42da-7dcf-4d6f-b706-6f16b981de4b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:25.034718 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-becf42da-7dcf-4d6f-b706-6f16b981de4b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:25.043050 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-becf42da-7dcf-4d6f-b706-6f16b981de4b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:25.043956 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-becf42da-7dcf-4d6f-b706-6f16b981de4b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:25.044552 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-becf42da-7dcf-4d6f-b706-6f16b981de4b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:25.045530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-becf42da-7dcf-4d6f-b706-6f16b981de4b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:25.046597 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-becf42da-7dcf-4d6f-b706-6f16b981de4b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:25.047191 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-becf42da-7dcf-4d6f-b706-6f16b981de4b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:25.119694 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2c6ac94c-3a75-4de1-a435-c3f739d0ed2f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:25.157192 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2c6ac94c-3a75-4de1-a435-c3f739d0ed2f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.484126 Aug 05 20:46:25.162579 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 146/285] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:24 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:25.236788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-8aa15d06-945f-466d-9bbf-d9d5368d711e req-51db16f1-2995-4db2-9845-f71b78f83653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784e7d44-0869-48e1-84f5-e35567f73947", "name": "network-vif-plugged", "status": "completed", "tag": "71f59c3d-04cf-4aa9-981a-c0db0c85c972"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:25.253076 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-8aa15d06-945f-466d-9bbf-d9d5368d711e req-51db16f1-2995-4db2-9845-f71b78f83653 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:25.257238 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-8aa15d06-945f-466d-9bbf-d9d5368d711e req-51db16f1-2995-4db2-9845-f71b78f83653 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:25.257925 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-8aa15d06-945f-466d-9bbf-d9d5368d711e req-51db16f1-2995-4db2-9845-f71b78f83653 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:25.283909 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-8aa15d06-945f-466d-9bbf-d9d5368d711e req-51db16f1-2995-4db2-9845-f71b78f83653 service nova] Creating event network-vif-plugged:71f59c3d-04cf-4aa9-981a-c0db0c85c972 for instance 784e7d44-0869-48e1-84f5-e35567f73947 on hv-cinder-85220 Aug 05 20:46:25.294519 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-8aa15d06-945f-466d-9bbf-d9d5368d711e req-51db16f1-2995-4db2-9845-f71b78f83653 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062202 Aug 05 20:46:25.295216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 147/286] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:46:25.300711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-066abb41-3dda-41d0-8f36-406bcf32951e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:25.301749 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-066abb41-3dda-41d0-8f36-406bcf32951e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:25.314996 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-066abb41-3dda-41d0-8f36-406bcf32951e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:25.315823 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-066abb41-3dda-41d0-8f36-406bcf32951e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:25.316455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-066abb41-3dda-41d0-8f36-406bcf32951e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:25.317438 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-066abb41-3dda-41d0-8f36-406bcf32951e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:25.318081 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-066abb41-3dda-41d0-8f36-406bcf32951e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:25.318694 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-066abb41-3dda-41d0-8f36-406bcf32951e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:25.744692 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-becf42da-7dcf-4d6f-b706-6f16b981de4b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:25.754529 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-becf42da-7dcf-4d6f-b706-6f16b981de4b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 0.726442 Aug 05 20:46:25.757615 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 140/287] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:25 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:25.767707 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a439bc52-583f-49e7-8a31-534e732ef0cc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:25.768434 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a439bc52-583f-49e7-8a31-534e732ef0cc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:25.780811 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a439bc52-583f-49e7-8a31-534e732ef0cc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:25.784054 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a439bc52-583f-49e7-8a31-534e732ef0cc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:25.784724 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a439bc52-583f-49e7-8a31-534e732ef0cc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:25.785917 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a439bc52-583f-49e7-8a31-534e732ef0cc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:25.788186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a439bc52-583f-49e7-8a31-534e732ef0cc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:25.789991 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a439bc52-583f-49e7-8a31-534e732ef0cc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:25.900692 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-066abb41-3dda-41d0-8f36-406bcf32951e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:25.909799 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-066abb41-3dda-41d0-8f36-406bcf32951e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:25.911390 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-066abb41-3dda-41d0-8f36-406bcf32951e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:25.913180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-066abb41-3dda-41d0-8f36-406bcf32951e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.616025 Aug 05 20:46:25.930248 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 148/288] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:25 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:25.949587 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-579182b1-74ac-4e52-8fa6-c68ae5b1ea9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:25.952413 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-579182b1-74ac-4e52-8fa6-c68ae5b1ea9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:25.959250 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-579182b1-74ac-4e52-8fa6-c68ae5b1ea9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:25.960157 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-579182b1-74ac-4e52-8fa6-c68ae5b1ea9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:25.960653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-579182b1-74ac-4e52-8fa6-c68ae5b1ea9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:25.961459 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-579182b1-74ac-4e52-8fa6-c68ae5b1ea9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:25.961974 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-579182b1-74ac-4e52-8fa6-c68ae5b1ea9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:25.962461 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-579182b1-74ac-4e52-8fa6-c68ae5b1ea9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:25.988004 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a439bc52-583f-49e7-8a31-534e732ef0cc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:25.996377 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a439bc52-583f-49e7-8a31-534e732ef0cc tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1712 microversion: 2.1 time: 0.237597 Aug 05 20:46:25.996958 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 141/289] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:25 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1712 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:26.002072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ca4677ea-c5b6-4d72-af3f-7b07aeaa95cb tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:26.003107 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ca4677ea-c5b6-4d72-af3f-7b07aeaa95cb tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:26.023143 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ca4677ea-c5b6-4d72-af3f-7b07aeaa95cb tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:26.023677 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ca4677ea-c5b6-4d72-af3f-7b07aeaa95cb tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:26.026445 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ca4677ea-c5b6-4d72-af3f-7b07aeaa95cb tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:26.027202 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ca4677ea-c5b6-4d72-af3f-7b07aeaa95cb tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:26.027704 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ca4677ea-c5b6-4d72-af3f-7b07aeaa95cb tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:26.028123 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ca4677ea-c5b6-4d72-af3f-7b07aeaa95cb tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:26.184647 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-579182b1-74ac-4e52-8fa6-c68ae5b1ea9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:26.202849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-579182b1-74ac-4e52-8fa6-c68ae5b1ea9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.271265 Aug 05 20:46:26.216443 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 149/290] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:25 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:26.216443 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9384c492-326b-45f6-876a-9e671bf381c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:26.216443 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9384c492-326b-45f6-876a-9e671bf381c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:26.242806 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9384c492-326b-45f6-876a-9e671bf381c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:26.243986 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9384c492-326b-45f6-876a-9e671bf381c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:26.244597 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9384c492-326b-45f6-876a-9e671bf381c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:26.245485 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9384c492-326b-45f6-876a-9e671bf381c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:26.246387 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9384c492-326b-45f6-876a-9e671bf381c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:26.246971 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9384c492-326b-45f6-876a-9e671bf381c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:26.332508 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ca4677ea-c5b6-4d72-af3f-7b07aeaa95cb tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:26.353762 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ca4677ea-c5b6-4d72-af3f-7b07aeaa95cb tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1502 microversion: 2.1 time: 0.355730 Aug 05 20:46:26.358196 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 142/291] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:25 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1502 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:26.464379 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9384c492-326b-45f6-876a-9e671bf381c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:26.472935 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9384c492-326b-45f6-876a-9e671bf381c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.268352 Aug 05 20:46:26.473512 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 150/292] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:26 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:26.778993 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7abf3405-cca6-4a57-a177-70b3ab2f2cb6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:26.780757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-7abf3405-cca6-4a57-a177-70b3ab2f2cb6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:26.791662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7abf3405-cca6-4a57-a177-70b3ab2f2cb6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:26.792653 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7abf3405-cca6-4a57-a177-70b3ab2f2cb6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:26.793465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7abf3405-cca6-4a57-a177-70b3ab2f2cb6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:26.794634 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7abf3405-cca6-4a57-a177-70b3ab2f2cb6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:26.795298 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7abf3405-cca6-4a57-a177-70b3ab2f2cb6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:26.795961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7abf3405-cca6-4a57-a177-70b3ab2f2cb6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:26.936696 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-83cbf2e4-ea0a-4788-b832-4110d7788fa7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:26.937545 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-83cbf2e4-ea0a-4788-b832-4110d7788fa7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:26.947663 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-83cbf2e4-ea0a-4788-b832-4110d7788fa7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:26.948440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-83cbf2e4-ea0a-4788-b832-4110d7788fa7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:26.949045 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-83cbf2e4-ea0a-4788-b832-4110d7788fa7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:26.949761 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-83cbf2e4-ea0a-4788-b832-4110d7788fa7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:26.950234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-83cbf2e4-ea0a-4788-b832-4110d7788fa7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:26.950668 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-83cbf2e4-ea0a-4788-b832-4110d7788fa7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:26.961395 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7abf3405-cca6-4a57-a177-70b3ab2f2cb6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:26.974740 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-7abf3405-cca6-4a57-a177-70b3ab2f2cb6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 0.200499 Aug 05 20:46:26.982572 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 143/293] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:26 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:27.017565 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-acb06d5b-4289-40e1-aa7b-0d7365c98597 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:27.018769 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-acb06d5b-4289-40e1-aa7b-0d7365c98597 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:27.024678 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-acb06d5b-4289-40e1-aa7b-0d7365c98597 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:27.025259 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-acb06d5b-4289-40e1-aa7b-0d7365c98597 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:27.025770 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-acb06d5b-4289-40e1-aa7b-0d7365c98597 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:27.026598 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-acb06d5b-4289-40e1-aa7b-0d7365c98597 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:27.027158 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-acb06d5b-4289-40e1-aa7b-0d7365c98597 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:27.027727 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-acb06d5b-4289-40e1-aa7b-0d7365c98597 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:27.143732 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-83cbf2e4-ea0a-4788-b832-4110d7788fa7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:27.152080 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-83cbf2e4-ea0a-4788-b832-4110d7788fa7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:27.153570 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-83cbf2e4-ea0a-4788-b832-4110d7788fa7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:27.154789 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-83cbf2e4-ea0a-4788-b832-4110d7788fa7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.222240 Aug 05 20:46:27.163334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 151/294] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:26 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:27.163334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b5f148a6-43e6-452e-bee7-d5c0674409c0 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:27.163334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b5f148a6-43e6-452e-bee7-d5c0674409c0 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:27.167171 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b5f148a6-43e6-452e-bee7-d5c0674409c0 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:27.168312 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b5f148a6-43e6-452e-bee7-d5c0674409c0 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:27.168312 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b5f148a6-43e6-452e-bee7-d5c0674409c0 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:27.168883 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b5f148a6-43e6-452e-bee7-d5c0674409c0 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:27.169329 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b5f148a6-43e6-452e-bee7-d5c0674409c0 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:27.169745 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b5f148a6-43e6-452e-bee7-d5c0674409c0 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:27.188223 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-acb06d5b-4289-40e1-aa7b-0d7365c98597 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:27.196337 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b5f148a6-43e6-452e-bee7-d5c0674409c0 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:46:27.197405 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-acb06d5b-4289-40e1-aa7b-0d7365c98597 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1712 microversion: 2.1 time: 0.183491 Aug 05 20:46:27.197975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 144/295] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:27 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1712 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:27.231000 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-86ae18d8-08ca-4c10-9599-996c86edd100 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:27.231882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-86ae18d8-08ca-4c10-9599-996c86edd100 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:27.239039 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-86ae18d8-08ca-4c10-9599-996c86edd100 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:27.239721 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-86ae18d8-08ca-4c10-9599-996c86edd100 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:27.240335 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-86ae18d8-08ca-4c10-9599-996c86edd100 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:27.241202 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-86ae18d8-08ca-4c10-9599-996c86edd100 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:27.242156 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-86ae18d8-08ca-4c10-9599-996c86edd100 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:27.243119 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-86ae18d8-08ca-4c10-9599-996c86edd100 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:27.316741 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b5f148a6-43e6-452e-bee7-d5c0674409c0 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 204 len: 0 microversion: 2.1 time: 0.158688 Aug 05 20:46:27.321022 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 152/296] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:46:27 2022] DELETE /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:46:27.326902 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8be387bd-d7a0-4b0f-a114-c80be764d781 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:27.332338 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8be387bd-d7a0-4b0f-a114-c80be764d781 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:27.340723 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8be387bd-d7a0-4b0f-a114-c80be764d781 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:27.341586 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8be387bd-d7a0-4b0f-a114-c80be764d781 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:27.342192 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8be387bd-d7a0-4b0f-a114-c80be764d781 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:27.344626 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8be387bd-d7a0-4b0f-a114-c80be764d781 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:27.345617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8be387bd-d7a0-4b0f-a114-c80be764d781 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:27.346586 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8be387bd-d7a0-4b0f-a114-c80be764d781 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:27.471028 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-86ae18d8-08ca-4c10-9599-996c86edd100 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:27.478938 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-86ae18d8-08ca-4c10-9599-996c86edd100 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.251876 Aug 05 20:46:27.479549 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 145/297] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:27 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:27.509410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4d4c5aa0-5fd6-47ff-95cb-f7ed9daad103 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:27.510525 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4d4c5aa0-5fd6-47ff-95cb-f7ed9daad103 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:27.520909 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4d4c5aa0-5fd6-47ff-95cb-f7ed9daad103 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:27.521720 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4d4c5aa0-5fd6-47ff-95cb-f7ed9daad103 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:27.522485 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4d4c5aa0-5fd6-47ff-95cb-f7ed9daad103 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:27.524008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4d4c5aa0-5fd6-47ff-95cb-f7ed9daad103 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:27.525001 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4d4c5aa0-5fd6-47ff-95cb-f7ed9daad103 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:27.525694 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4d4c5aa0-5fd6-47ff-95cb-f7ed9daad103 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:27.588515 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8be387bd-d7a0-4b0f-a114-c80be764d781 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:27.604012 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8be387bd-d7a0-4b0f-a114-c80be764d781 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1508 microversion: 2.1 time: 0.281156 Aug 05 20:46:27.604837 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 153/298] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:27 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1508 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:27.692326 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4d4c5aa0-5fd6-47ff-95cb-f7ed9daad103 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:27.700268 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4d4c5aa0-5fd6-47ff-95cb-f7ed9daad103 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.196580 Aug 05 20:46:27.700842 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 146/299] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:27 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:28.004276 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b8febb5f-e5ea-429b-86f4-9b8365e03499 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:28.004947 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b8febb5f-e5ea-429b-86f4-9b8365e03499 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:28.011920 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b8febb5f-e5ea-429b-86f4-9b8365e03499 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:28.012654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b8febb5f-e5ea-429b-86f4-9b8365e03499 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:28.013282 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b8febb5f-e5ea-429b-86f4-9b8365e03499 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:28.013996 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b8febb5f-e5ea-429b-86f4-9b8365e03499 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:28.014434 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b8febb5f-e5ea-429b-86f4-9b8365e03499 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:28.014832 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b8febb5f-e5ea-429b-86f4-9b8365e03499 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:28.118147 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:28.160082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b8febb5f-e5ea-429b-86f4-9b8365e03499 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:28.162439 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=10 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:28.169460 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b8febb5f-e5ea-429b-86f4-9b8365e03499 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 0.170343 Aug 05 20:46:28.170057 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 154/300] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:27 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:28.178857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a5775296-f168-4595-993e-12bb660be59f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:28.179620 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a5775296-f168-4595-993e-12bb660be59f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:28.187285 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a5775296-f168-4595-993e-12bb660be59f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:28.188008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a5775296-f168-4595-993e-12bb660be59f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:28.188670 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a5775296-f168-4595-993e-12bb660be59f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:28.189754 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a5775296-f168-4595-993e-12bb660be59f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:28.190463 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a5775296-f168-4595-993e-12bb660be59f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:28.190882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a5775296-f168-4595-993e-12bb660be59f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:28.259827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-df4af2fb-849c-43c8-b61d-346b50f39dc9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:28.260505 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-df4af2fb-849c-43c8-b61d-346b50f39dc9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:28.332100 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-df4af2fb-849c-43c8-b61d-346b50f39dc9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:28.333389 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-df4af2fb-849c-43c8-b61d-346b50f39dc9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:28.334217 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-df4af2fb-849c-43c8-b61d-346b50f39dc9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:28.335581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-df4af2fb-849c-43c8-b61d-346b50f39dc9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:28.336263 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-df4af2fb-849c-43c8-b61d-346b50f39dc9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:28.338386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-df4af2fb-849c-43c8-b61d-346b50f39dc9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:28.534190 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a5775296-f168-4595-993e-12bb660be59f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:28.542917 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a5775296-f168-4595-993e-12bb660be59f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:28.545018 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a5775296-f168-4595-993e-12bb660be59f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:28.546256 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a5775296-f168-4595-993e-12bb660be59f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.372054 Aug 05 20:46:28.546978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 147/301] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:28 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:28.552175 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-2b6e12ee-442b-44fe-9208-d5ac11e619bd tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:28.552795 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-2b6e12ee-442b-44fe-9208-d5ac11e619bd tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:28.566569 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2b6e12ee-442b-44fe-9208-d5ac11e619bd tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:28.567693 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2b6e12ee-442b-44fe-9208-d5ac11e619bd tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:28.568728 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2b6e12ee-442b-44fe-9208-d5ac11e619bd tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:28.569600 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2b6e12ee-442b-44fe-9208-d5ac11e619bd tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:28.570115 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2b6e12ee-442b-44fe-9208-d5ac11e619bd tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:28.570564 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2b6e12ee-442b-44fe-9208-d5ac11e619bd tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:28.603506 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-df4af2fb-849c-43c8-b61d-346b50f39dc9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:28.619531 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-df4af2fb-849c-43c8-b61d-346b50f39dc9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1712 microversion: 2.1 time: 0.395087 Aug 05 20:46:28.631408 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 155/302] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:28 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1712 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:28.636439 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-479543ab-dc25-465a-8746-42fccf568bda tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:28.637134 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-479543ab-dc25-465a-8746-42fccf568bda tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:28.646191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-479543ab-dc25-465a-8746-42fccf568bda tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:28.646835 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-479543ab-dc25-465a-8746-42fccf568bda tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:28.647416 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-479543ab-dc25-465a-8746-42fccf568bda tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:28.648202 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-479543ab-dc25-465a-8746-42fccf568bda tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:28.648682 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-479543ab-dc25-465a-8746-42fccf568bda tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:28.649118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-479543ab-dc25-465a-8746-42fccf568bda tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:28.773666 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2b6e12ee-442b-44fe-9208-d5ac11e619bd tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:28.787617 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-2b6e12ee-442b-44fe-9208-d5ac11e619bd tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.239396 Aug 05 20:46:28.791436 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 148/303] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:28 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:28.801360 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e69d8526-7af3-402c-ab30-40ce6e2b0179 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:28.801997 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e69d8526-7af3-402c-ab30-40ce6e2b0179 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:28.811780 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e69d8526-7af3-402c-ab30-40ce6e2b0179 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:28.812562 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e69d8526-7af3-402c-ab30-40ce6e2b0179 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:28.813091 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e69d8526-7af3-402c-ab30-40ce6e2b0179 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:28.813902 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e69d8526-7af3-402c-ab30-40ce6e2b0179 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:28.814465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e69d8526-7af3-402c-ab30-40ce6e2b0179 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:28.815077 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e69d8526-7af3-402c-ab30-40ce6e2b0179 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:28.835718 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-479543ab-dc25-465a-8746-42fccf568bda tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:28.848607 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-479543ab-dc25-465a-8746-42fccf568bda tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1508 microversion: 2.1 time: 0.216128 Aug 05 20:46:28.849198 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 156/304] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:28 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:29.003217 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-e69d8526-7af3-402c-ab30-40ce6e2b0179 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:29.011029 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e69d8526-7af3-402c-ab30-40ce6e2b0179 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.220922 Aug 05 20:46:29.011599 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 149/305] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:28 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:29.190245 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-60ef65f4-b1db-41d9-aaa7-6ebcc2dbb033 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:29.190850 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-60ef65f4-b1db-41d9-aaa7-6ebcc2dbb033 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:29.197513 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-60ef65f4-b1db-41d9-aaa7-6ebcc2dbb033 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:29.198004 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-60ef65f4-b1db-41d9-aaa7-6ebcc2dbb033 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:29.198468 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-60ef65f4-b1db-41d9-aaa7-6ebcc2dbb033 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:29.199161 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-60ef65f4-b1db-41d9-aaa7-6ebcc2dbb033 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:29.199716 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-60ef65f4-b1db-41d9-aaa7-6ebcc2dbb033 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:29.200139 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-60ef65f4-b1db-41d9-aaa7-6ebcc2dbb033 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:29.379124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-60ef65f4-b1db-41d9-aaa7-6ebcc2dbb033 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:29.397205 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-60ef65f4-b1db-41d9-aaa7-6ebcc2dbb033 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 0.210934 Aug 05 20:46:29.397800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 157/306] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:29 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:29.574746 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-48e1335e-79c6-46b3-b51b-fe5cbeed6e53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:29.575675 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-48e1335e-79c6-46b3-b51b-fe5cbeed6e53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:29.583244 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-48e1335e-79c6-46b3-b51b-fe5cbeed6e53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:29.583796 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-48e1335e-79c6-46b3-b51b-fe5cbeed6e53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:29.584238 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-48e1335e-79c6-46b3-b51b-fe5cbeed6e53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:29.584948 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-48e1335e-79c6-46b3-b51b-fe5cbeed6e53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:29.585546 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-48e1335e-79c6-46b3-b51b-fe5cbeed6e53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:29.586080 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-48e1335e-79c6-46b3-b51b-fe5cbeed6e53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:29.604123 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=6 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:29.641945 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-48ef8995-813b-488c-a271-544f3f85b360 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:29.642556 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-48ef8995-813b-488c-a271-544f3f85b360 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:29.649051 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48ef8995-813b-488c-a271-544f3f85b360 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:29.649472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48ef8995-813b-488c-a271-544f3f85b360 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:29.649933 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48ef8995-813b-488c-a271-544f3f85b360 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:29.650624 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48ef8995-813b-488c-a271-544f3f85b360 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:29.667386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48ef8995-813b-488c-a271-544f3f85b360 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:29.667386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48ef8995-813b-488c-a271-544f3f85b360 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:29.778614 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-48e1335e-79c6-46b3-b51b-fe5cbeed6e53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:29.788038 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-48e1335e-79c6-46b3-b51b-fe5cbeed6e53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:29.789562 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-48e1335e-79c6-46b3-b51b-fe5cbeed6e53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:29.790776 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-48e1335e-79c6-46b3-b51b-fe5cbeed6e53 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.222618 Aug 05 20:46:29.791413 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 150/307] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:29 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:29.808551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-815a649c-451d-4bd7-96ce-d051cad637b6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:29.809428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-815a649c-451d-4bd7-96ce-d051cad637b6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:29.816392 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-815a649c-451d-4bd7-96ce-d051cad637b6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:29.816982 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-815a649c-451d-4bd7-96ce-d051cad637b6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:29.817498 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-815a649c-451d-4bd7-96ce-d051cad637b6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:29.818280 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-815a649c-451d-4bd7-96ce-d051cad637b6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:29.819576 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-815a649c-451d-4bd7-96ce-d051cad637b6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:29.820038 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-815a649c-451d-4bd7-96ce-d051cad637b6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:29.841438 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-48ef8995-813b-488c-a271-544f3f85b360 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:29.849677 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-48ef8995-813b-488c-a271-544f3f85b360 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1712 microversion: 2.1 time: 0.211652 Aug 05 20:46:29.850274 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 158/308] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:29 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1712 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:29.871325 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4ba325fe-235b-4125-a976-fb6c03f8b3c8 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:29.872222 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4ba325fe-235b-4125-a976-fb6c03f8b3c8 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:29.891595 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4ba325fe-235b-4125-a976-fb6c03f8b3c8 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:29.894119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4ba325fe-235b-4125-a976-fb6c03f8b3c8 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:29.895236 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4ba325fe-235b-4125-a976-fb6c03f8b3c8 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:29.897834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4ba325fe-235b-4125-a976-fb6c03f8b3c8 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:29.899261 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4ba325fe-235b-4125-a976-fb6c03f8b3c8 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:29.900457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4ba325fe-235b-4125-a976-fb6c03f8b3c8 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:30.341846 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-815a649c-451d-4bd7-96ce-d051cad637b6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:30.351993 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-815a649c-451d-4bd7-96ce-d051cad637b6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.547188 Aug 05 20:46:30.353737 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4ba325fe-235b-4125-a976-fb6c03f8b3c8 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:30.362638 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4ba325fe-235b-4125-a976-fb6c03f8b3c8 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1508 microversion: 2.1 time: 0.495660 Aug 05 20:46:30.363778 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 159/309] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:29 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1508 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:30.366128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 151/310] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:29 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:30.368952 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5b0414ca-0f4a-4335-8c7c-c6197c143b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:30.369766 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5b0414ca-0f4a-4335-8c7c-c6197c143b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:30.376215 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b0414ca-0f4a-4335-8c7c-c6197c143b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:30.376926 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b0414ca-0f4a-4335-8c7c-c6197c143b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:30.377659 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b0414ca-0f4a-4335-8c7c-c6197c143b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:30.378557 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b0414ca-0f4a-4335-8c7c-c6197c143b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:30.379169 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b0414ca-0f4a-4335-8c7c-c6197c143b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:30.380269 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b0414ca-0f4a-4335-8c7c-c6197c143b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:30.424888 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e79385a0-51f6-4ff1-ac9e-b3dc124e2a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:30.425720 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e79385a0-51f6-4ff1-ac9e-b3dc124e2a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:30.439737 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e79385a0-51f6-4ff1-ac9e-b3dc124e2a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:30.441056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e79385a0-51f6-4ff1-ac9e-b3dc124e2a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:30.444120 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e79385a0-51f6-4ff1-ac9e-b3dc124e2a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:30.445117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e79385a0-51f6-4ff1-ac9e-b3dc124e2a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:30.445707 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e79385a0-51f6-4ff1-ac9e-b3dc124e2a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:30.446248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e79385a0-51f6-4ff1-ac9e-b3dc124e2a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:30.651388 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5b0414ca-0f4a-4335-8c7c-c6197c143b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:30.657680 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5b0414ca-0f4a-4335-8c7c-c6197c143b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.292590 Aug 05 20:46:30.670616 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 160/311] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:30 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:30.724329 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-e79385a0-51f6-4ff1-ac9e-b3dc124e2a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:30.732009 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e79385a0-51f6-4ff1-ac9e-b3dc124e2a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 0.314332 Aug 05 20:46:30.732614 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 152/312] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:30 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:30.813304 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4cbd7b4a-ae61-45fb-af40-494629390bf1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:30.813843 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4cbd7b4a-ae61-45fb-af40-494629390bf1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:30.823655 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cbd7b4a-ae61-45fb-af40-494629390bf1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:30.824200 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cbd7b4a-ae61-45fb-af40-494629390bf1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:30.824796 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cbd7b4a-ae61-45fb-af40-494629390bf1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:30.825807 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cbd7b4a-ae61-45fb-af40-494629390bf1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:30.826493 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cbd7b4a-ae61-45fb-af40-494629390bf1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:30.827103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cbd7b4a-ae61-45fb-af40-494629390bf1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:30.875190 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-11621ed0-d849-46ec-8fcc-4229e2cf1be9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:30.875190 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-11621ed0-d849-46ec-8fcc-4229e2cf1be9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:30.885728 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-11621ed0-d849-46ec-8fcc-4229e2cf1be9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:30.886337 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-11621ed0-d849-46ec-8fcc-4229e2cf1be9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:30.886893 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-11621ed0-d849-46ec-8fcc-4229e2cf1be9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:30.887841 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-11621ed0-d849-46ec-8fcc-4229e2cf1be9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:30.888442 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-11621ed0-d849-46ec-8fcc-4229e2cf1be9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:30.888850 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-11621ed0-d849-46ec-8fcc-4229e2cf1be9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:31.038569 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4cbd7b4a-ae61-45fb-af40-494629390bf1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:31.055233 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4cbd7b4a-ae61-45fb-af40-494629390bf1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:31.058341 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4cbd7b4a-ae61-45fb-af40-494629390bf1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:31.062015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4cbd7b4a-ae61-45fb-af40-494629390bf1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.251468 Aug 05 20:46:31.062601 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 161/313] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:30 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:31.113694 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-11621ed0-d849-46ec-8fcc-4229e2cf1be9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:31.122503 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-11621ed0-d849-46ec-8fcc-4229e2cf1be9 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1712 microversion: 2.1 time: 0.254127 Aug 05 20:46:31.123311 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 153/314] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:30 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1712 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:31.373158 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-29a08269-3b7c-4b39-8464-ce0b42428e75 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:31.374193 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-29a08269-3b7c-4b39-8464-ce0b42428e75 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:31.380550 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29a08269-3b7c-4b39-8464-ce0b42428e75 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:31.381128 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29a08269-3b7c-4b39-8464-ce0b42428e75 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:31.381572 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29a08269-3b7c-4b39-8464-ce0b42428e75 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:31.382518 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29a08269-3b7c-4b39-8464-ce0b42428e75 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:31.382977 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29a08269-3b7c-4b39-8464-ce0b42428e75 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:31.383409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29a08269-3b7c-4b39-8464-ce0b42428e75 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:31.387035 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:31.390961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d4383ce9-ef54-45c7-8a13-ce46aee3a499 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:31.391602 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d4383ce9-ef54-45c7-8a13-ce46aee3a499 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:31.397902 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d4383ce9-ef54-45c7-8a13-ce46aee3a499 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:31.398366 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d4383ce9-ef54-45c7-8a13-ce46aee3a499 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:31.398794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d4383ce9-ef54-45c7-8a13-ce46aee3a499 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:31.400042 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d4383ce9-ef54-45c7-8a13-ce46aee3a499 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:31.401298 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d4383ce9-ef54-45c7-8a13-ce46aee3a499 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:31.401630 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d4383ce9-ef54-45c7-8a13-ce46aee3a499 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:31.596328 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-29a08269-3b7c-4b39-8464-ce0b42428e75 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:31.603962 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d4383ce9-ef54-45c7-8a13-ce46aee3a499 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:31.604410 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-29a08269-3b7c-4b39-8464-ce0b42428e75 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.235237 Aug 05 20:46:31.604990 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 162/315] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:31 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:31.634410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d4383ce9-ef54-45c7-8a13-ce46aee3a499 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1508 microversion: 2.1 time: 0.250374 Aug 05 20:46:31.639672 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 154/316] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:31 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:31.685142 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-472754fc-d334-4b1f-87cd-1ec7592e56fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:31.685981 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-472754fc-d334-4b1f-87cd-1ec7592e56fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:31.687992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:31.695385 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-472754fc-d334-4b1f-87cd-1ec7592e56fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:31.695982 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-472754fc-d334-4b1f-87cd-1ec7592e56fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:31.696533 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-472754fc-d334-4b1f-87cd-1ec7592e56fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:31.697316 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-472754fc-d334-4b1f-87cd-1ec7592e56fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:31.697840 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-472754fc-d334-4b1f-87cd-1ec7592e56fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:31.698340 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-472754fc-d334-4b1f-87cd-1ec7592e56fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:31.756525 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-32a93025-0db5-40fe-9310-3ac87a8a9d70 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:31.757187 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-32a93025-0db5-40fe-9310-3ac87a8a9d70 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:31.770765 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-32a93025-0db5-40fe-9310-3ac87a8a9d70 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:31.773318 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-32a93025-0db5-40fe-9310-3ac87a8a9d70 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:31.774709 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-32a93025-0db5-40fe-9310-3ac87a8a9d70 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:31.776037 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-32a93025-0db5-40fe-9310-3ac87a8a9d70 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:31.776788 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-32a93025-0db5-40fe-9310-3ac87a8a9d70 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:31.777468 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-32a93025-0db5-40fe-9310-3ac87a8a9d70 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:31.786620 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=100 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:31.883104 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-472754fc-d334-4b1f-87cd-1ec7592e56fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:31.891019 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-472754fc-d334-4b1f-87cd-1ec7592e56fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.209580 Aug 05 20:46:31.891945 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 163/317] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:31 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:31.987692 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-32a93025-0db5-40fe-9310-3ac87a8a9d70 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:31.995620 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-32a93025-0db5-40fe-9310-3ac87a8a9d70 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 0.244203 Aug 05 20:46:31.996418 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 155/318] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:31 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:32.087765 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d9e47841-c069-4983-bfaa-118a12541c6f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:32.088368 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d9e47841-c069-4983-bfaa-118a12541c6f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:32.097220 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9e47841-c069-4983-bfaa-118a12541c6f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:32.097711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9e47841-c069-4983-bfaa-118a12541c6f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:32.098145 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9e47841-c069-4983-bfaa-118a12541c6f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:32.098842 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9e47841-c069-4983-bfaa-118a12541c6f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:32.099296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9e47841-c069-4983-bfaa-118a12541c6f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:32.099755 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9e47841-c069-4983-bfaa-118a12541c6f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:32.146036 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-86a94e90-091b-41ab-b427-b2054c118fc5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:32.146746 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-86a94e90-091b-41ab-b427-b2054c118fc5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:32.153240 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-86a94e90-091b-41ab-b427-b2054c118fc5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:32.153818 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-86a94e90-091b-41ab-b427-b2054c118fc5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:32.154349 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-86a94e90-091b-41ab-b427-b2054c118fc5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:32.155471 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-86a94e90-091b-41ab-b427-b2054c118fc5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:32.156023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-86a94e90-091b-41ab-b427-b2054c118fc5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:32.156544 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-86a94e90-091b-41ab-b427-b2054c118fc5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:32.330244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d9e47841-c069-4983-bfaa-118a12541c6f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:32.340514 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d9e47841-c069-4983-bfaa-118a12541c6f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:32.342372 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d9e47841-c069-4983-bfaa-118a12541c6f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:32.343793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d9e47841-c069-4983-bfaa-118a12541c6f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.261372 Aug 05 20:46:32.359751 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 164/319] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:32 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:32.382658 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-86a94e90-091b-41ab-b427-b2054c118fc5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:32.391111 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-86a94e90-091b-41ab-b427-b2054c118fc5 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1712 microversion: 2.1 time: 0.250482 Aug 05 20:46:32.404707 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 156/320] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:32 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1712 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:32.629734 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-88324f74-b31a-4f7e-abf7-603cc1e1ed80 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:32.630371 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-88324f74-b31a-4f7e-abf7-603cc1e1ed80 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:32.637249 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-88324f74-b31a-4f7e-abf7-603cc1e1ed80 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:32.637738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-88324f74-b31a-4f7e-abf7-603cc1e1ed80 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:32.638176 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-88324f74-b31a-4f7e-abf7-603cc1e1ed80 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:32.638869 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-88324f74-b31a-4f7e-abf7-603cc1e1ed80 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:32.639323 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-88324f74-b31a-4f7e-abf7-603cc1e1ed80 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:32.639775 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-88324f74-b31a-4f7e-abf7-603cc1e1ed80 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:32.662202 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-371d1b32-debc-47e6-97f8-19f86fa4575b tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:32.663336 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-371d1b32-debc-47e6-97f8-19f86fa4575b tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:32.671512 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-371d1b32-debc-47e6-97f8-19f86fa4575b tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:32.672649 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-371d1b32-debc-47e6-97f8-19f86fa4575b tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:32.673488 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-371d1b32-debc-47e6-97f8-19f86fa4575b tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:32.674497 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-371d1b32-debc-47e6-97f8-19f86fa4575b tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:32.675185 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-371d1b32-debc-47e6-97f8-19f86fa4575b tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:32.675863 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-371d1b32-debc-47e6-97f8-19f86fa4575b tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:32.897729 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-88324f74-b31a-4f7e-abf7-603cc1e1ed80 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:32.900989 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-371d1b32-debc-47e6-97f8-19f86fa4575b tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:32.906868 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-88324f74-b31a-4f7e-abf7-603cc1e1ed80 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.282396 Aug 05 20:46:32.907709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 165/321] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:32 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:32.910191 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-371d1b32-debc-47e6-97f8-19f86fa4575b tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1508 microversion: 2.1 time: 0.253751 Aug 05 20:46:32.910910 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 157/322] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:32 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:32.912424 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6622feeb-3606-484f-92f2-f9f43f4bb630 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:32.912965 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6622feeb-3606-484f-92f2-f9f43f4bb630 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:32.921867 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6622feeb-3606-484f-92f2-f9f43f4bb630 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:32.922432 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6622feeb-3606-484f-92f2-f9f43f4bb630 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:32.922996 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6622feeb-3606-484f-92f2-f9f43f4bb630 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:32.923797 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6622feeb-3606-484f-92f2-f9f43f4bb630 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:32.924562 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6622feeb-3606-484f-92f2-f9f43f4bb630 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:32.925208 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6622feeb-3606-484f-92f2-f9f43f4bb630 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:33.016613 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-33f5b6c1-5edb-4fdf-932b-6dcc45e1d523 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:33.017348 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-33f5b6c1-5edb-4fdf-932b-6dcc45e1d523 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:33.023813 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-33f5b6c1-5edb-4fdf-932b-6dcc45e1d523 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:33.024395 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-33f5b6c1-5edb-4fdf-932b-6dcc45e1d523 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:33.024905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-33f5b6c1-5edb-4fdf-932b-6dcc45e1d523 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:33.025611 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-33f5b6c1-5edb-4fdf-932b-6dcc45e1d523 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:33.026067 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-33f5b6c1-5edb-4fdf-932b-6dcc45e1d523 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:33.026497 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-33f5b6c1-5edb-4fdf-932b-6dcc45e1d523 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:33.073827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6622feeb-3606-484f-92f2-f9f43f4bb630 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:33.081756 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6622feeb-3606-484f-92f2-f9f43f4bb630 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.173175 Aug 05 20:46:33.082321 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 166/323] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:32 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:33.162648 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-33f5b6c1-5edb-4fdf-932b-6dcc45e1d523 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:33.174013 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-33f5b6c1-5edb-4fdf-932b-6dcc45e1d523 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 0.161047 Aug 05 20:46:33.174807 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 158/324] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:33 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:33.366366 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-22b83683-5766-4b18-8fe7-ac822c9c6c2e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:33.366960 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-22b83683-5766-4b18-8fe7-ac822c9c6c2e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:33.373161 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-22b83683-5766-4b18-8fe7-ac822c9c6c2e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:33.373647 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-22b83683-5766-4b18-8fe7-ac822c9c6c2e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:33.374068 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-22b83683-5766-4b18-8fe7-ac822c9c6c2e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:33.374735 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-22b83683-5766-4b18-8fe7-ac822c9c6c2e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:33.375178 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-22b83683-5766-4b18-8fe7-ac822c9c6c2e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:33.375623 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-22b83683-5766-4b18-8fe7-ac822c9c6c2e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:33.412203 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c2678101-96b3-4c2b-ae2e-825c81207ae6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:33.412866 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c2678101-96b3-4c2b-ae2e-825c81207ae6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:33.422488 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2678101-96b3-4c2b-ae2e-825c81207ae6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:33.423862 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2678101-96b3-4c2b-ae2e-825c81207ae6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:33.424790 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2678101-96b3-4c2b-ae2e-825c81207ae6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:33.426786 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2678101-96b3-4c2b-ae2e-825c81207ae6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:33.428037 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2678101-96b3-4c2b-ae2e-825c81207ae6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:33.429100 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2678101-96b3-4c2b-ae2e-825c81207ae6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:33.570756 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-22b83683-5766-4b18-8fe7-ac822c9c6c2e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:33.579095 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-22b83683-5766-4b18-8fe7-ac822c9c6c2e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:33.580727 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-22b83683-5766-4b18-8fe7-ac822c9c6c2e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:33.581911 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-22b83683-5766-4b18-8fe7-ac822c9c6c2e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.219570 Aug 05 20:46:33.582457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 167/325] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:33 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:33.609829 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c2678101-96b3-4c2b-ae2e-825c81207ae6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:33.618736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c2678101-96b3-4c2b-ae2e-825c81207ae6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1712 microversion: 2.1 time: 0.210541 Aug 05 20:46:33.619296 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 159/326] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:33 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1712 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:33.930767 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0700fa4a-639d-4e9c-9875-0c3c892efabf tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:33.931428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-62cadee1-10f2-41fe-ab0b-10aab5b4ce48 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:33.931846 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0700fa4a-639d-4e9c-9875-0c3c892efabf tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:33.931947 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-62cadee1-10f2-41fe-ab0b-10aab5b4ce48 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:33.938439 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0700fa4a-639d-4e9c-9875-0c3c892efabf tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:33.938614 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-62cadee1-10f2-41fe-ab0b-10aab5b4ce48 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:33.938929 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-62cadee1-10f2-41fe-ab0b-10aab5b4ce48 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:33.939087 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0700fa4a-639d-4e9c-9875-0c3c892efabf tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:33.939388 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0700fa4a-639d-4e9c-9875-0c3c892efabf tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:33.939548 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-62cadee1-10f2-41fe-ab0b-10aab5b4ce48 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:33.940124 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-62cadee1-10f2-41fe-ab0b-10aab5b4ce48 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:33.940447 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0700fa4a-639d-4e9c-9875-0c3c892efabf tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:33.940678 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-62cadee1-10f2-41fe-ab0b-10aab5b4ce48 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:33.940911 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0700fa4a-639d-4e9c-9875-0c3c892efabf tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:33.941086 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-62cadee1-10f2-41fe-ab0b-10aab5b4ce48 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:33.941359 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0700fa4a-639d-4e9c-9875-0c3c892efabf tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:34.141896 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-62cadee1-10f2-41fe-ab0b-10aab5b4ce48 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:34.145417 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0700fa4a-639d-4e9c-9875-0c3c892efabf tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:34.149840 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-62cadee1-10f2-41fe-ab0b-10aab5b4ce48 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1508 microversion: 2.1 time: 0.222854 Aug 05 20:46:34.150455 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 160/327] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:33 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:34.153173 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0700fa4a-639d-4e9c-9875-0c3c892efabf tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.226378 Aug 05 20:46:34.153882 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 168/328] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:33 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:34.155830 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a5beb81e-f4da-401f-9b8a-6f891f8c3e88 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:34.156500 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a5beb81e-f4da-401f-9b8a-6f891f8c3e88 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:34.162410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a5beb81e-f4da-401f-9b8a-6f891f8c3e88 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:34.162975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a5beb81e-f4da-401f-9b8a-6f891f8c3e88 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:34.163512 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a5beb81e-f4da-401f-9b8a-6f891f8c3e88 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:34.164312 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a5beb81e-f4da-401f-9b8a-6f891f8c3e88 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:34.164766 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a5beb81e-f4da-401f-9b8a-6f891f8c3e88 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:34.165185 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a5beb81e-f4da-401f-9b8a-6f891f8c3e88 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:34.201129 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-af28d9a5-1aa9-4f76-858e-dc788f8df09e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:34.201742 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-af28d9a5-1aa9-4f76-858e-dc788f8df09e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:34.208456 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af28d9a5-1aa9-4f76-858e-dc788f8df09e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:34.208950 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af28d9a5-1aa9-4f76-858e-dc788f8df09e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:34.209384 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af28d9a5-1aa9-4f76-858e-dc788f8df09e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:34.210093 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af28d9a5-1aa9-4f76-858e-dc788f8df09e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:34.210552 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af28d9a5-1aa9-4f76-858e-dc788f8df09e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:34.210979 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af28d9a5-1aa9-4f76-858e-dc788f8df09e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:34.342677 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a5beb81e-f4da-401f-9b8a-6f891f8c3e88 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:34.350848 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a5beb81e-f4da-401f-9b8a-6f891f8c3e88 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.199321 Aug 05 20:46:34.351513 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 161/329] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:34 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:34.372859 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-af28d9a5-1aa9-4f76-858e-dc788f8df09e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:34.381821 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-af28d9a5-1aa9-4f76-858e-dc788f8df09e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 0.184491 Aug 05 20:46:34.382425 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 169/330] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:34 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:34.606406 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7a9a4e30-9713-49b4-a672-461f8a04fb42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:34.607011 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-7a9a4e30-9713-49b4-a672-461f8a04fb42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:34.613601 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7a9a4e30-9713-49b4-a672-461f8a04fb42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:34.614080 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7a9a4e30-9713-49b4-a672-461f8a04fb42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:34.614503 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7a9a4e30-9713-49b4-a672-461f8a04fb42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:34.615190 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7a9a4e30-9713-49b4-a672-461f8a04fb42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:34.615672 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7a9a4e30-9713-49b4-a672-461f8a04fb42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:34.616093 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7a9a4e30-9713-49b4-a672-461f8a04fb42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:34.647373 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-baf7744b-0cef-4ade-93a8-9ee867e38d11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:34.648017 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-baf7744b-0cef-4ade-93a8-9ee867e38d11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:34.654341 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-baf7744b-0cef-4ade-93a8-9ee867e38d11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:34.654845 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-baf7744b-0cef-4ade-93a8-9ee867e38d11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:34.655608 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-baf7744b-0cef-4ade-93a8-9ee867e38d11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:34.656313 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-baf7744b-0cef-4ade-93a8-9ee867e38d11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:34.656758 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-baf7744b-0cef-4ade-93a8-9ee867e38d11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:34.657172 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-baf7744b-0cef-4ade-93a8-9ee867e38d11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:34.947290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7a9a4e30-9713-49b4-a672-461f8a04fb42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:34.956036 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7a9a4e30-9713-49b4-a672-461f8a04fb42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:34.957760 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7a9a4e30-9713-49b4-a672-461f8a04fb42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:34.958953 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-7a9a4e30-9713-49b4-a672-461f8a04fb42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.356528 Aug 05 20:46:34.959750 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 162/331] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:34 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:34.974705 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-baf7744b-0cef-4ade-93a8-9ee867e38d11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:34.986312 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-baf7744b-0cef-4ade-93a8-9ee867e38d11 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1712 microversion: 2.1 time: 0.342732 Aug 05 20:46:34.986900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 170/332] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:34 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1712 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:35.177161 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8480577d-cb85-4a04-8336-00b3b1478897 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:35.177161 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8480577d-cb85-4a04-8336-00b3b1478897 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:35.182898 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8480577d-cb85-4a04-8336-00b3b1478897 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:35.183474 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e8c43f5a-4968-4f6c-b3b5-13ca81572e95 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:35.183825 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8480577d-cb85-4a04-8336-00b3b1478897 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:35.184089 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e8c43f5a-4968-4f6c-b3b5-13ca81572e95 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:35.184571 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8480577d-cb85-4a04-8336-00b3b1478897 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:35.185412 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8480577d-cb85-4a04-8336-00b3b1478897 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:35.186008 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8480577d-cb85-4a04-8336-00b3b1478897 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:35.186622 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8480577d-cb85-4a04-8336-00b3b1478897 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:35.190320 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e8c43f5a-4968-4f6c-b3b5-13ca81572e95 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:35.190806 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e8c43f5a-4968-4f6c-b3b5-13ca81572e95 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:35.191292 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e8c43f5a-4968-4f6c-b3b5-13ca81572e95 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:35.192088 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e8c43f5a-4968-4f6c-b3b5-13ca81572e95 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:35.192536 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e8c43f5a-4968-4f6c-b3b5-13ca81572e95 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:35.192929 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e8c43f5a-4968-4f6c-b3b5-13ca81572e95 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:35.455814 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-e8c43f5a-4968-4f6c-b3b5-13ca81572e95 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:35.464508 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e8c43f5a-4968-4f6c-b3b5-13ca81572e95 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1508 microversion: 2.1 time: 0.296412 Aug 05 20:46:35.465858 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 163/333] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:35 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1508 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:35.473132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8480577d-cb85-4a04-8336-00b3b1478897 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:35.475078 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-69a8bb9e-04af-4ed7-ab2b-a7ba11324837 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:35.478913 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-69a8bb9e-04af-4ed7-ab2b-a7ba11324837 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:35.483465 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8480577d-cb85-4a04-8336-00b3b1478897 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.311563 Aug 05 20:46:35.484333 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 171/334] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:35 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:35.491291 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-69a8bb9e-04af-4ed7-ab2b-a7ba11324837 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:35.491291 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-69a8bb9e-04af-4ed7-ab2b-a7ba11324837 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:35.491291 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-69a8bb9e-04af-4ed7-ab2b-a7ba11324837 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:35.491291 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-69a8bb9e-04af-4ed7-ab2b-a7ba11324837 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:35.491845 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-69a8bb9e-04af-4ed7-ab2b-a7ba11324837 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:35.491845 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-69a8bb9e-04af-4ed7-ab2b-a7ba11324837 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:35.492023 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d6c6efea-6286-4b6a-9a1c-48fe49008748 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:35.492023 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d6c6efea-6286-4b6a-9a1c-48fe49008748 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:35.500218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6c6efea-6286-4b6a-9a1c-48fe49008748 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:35.500891 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6c6efea-6286-4b6a-9a1c-48fe49008748 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:35.501443 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6c6efea-6286-4b6a-9a1c-48fe49008748 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:35.502703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6c6efea-6286-4b6a-9a1c-48fe49008748 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:35.502824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6c6efea-6286-4b6a-9a1c-48fe49008748 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:35.503469 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d6c6efea-6286-4b6a-9a1c-48fe49008748 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:35.759552 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-69a8bb9e-04af-4ed7-ab2b-a7ba11324837 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:35.768550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-69a8bb9e-04af-4ed7-ab2b-a7ba11324837 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.300946 Aug 05 20:46:35.769293 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 164/335] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:35 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:35.772993 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d6c6efea-6286-4b6a-9a1c-48fe49008748 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:35.774046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-8eb01aea-d4e5-4372-bc50-d678f2bd2dc8 req-7b5b5a92-a54b-4847-9601-6154e7913af2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a270d6db-218c-4081-81b9-b161dc70a7bb", "tag": "ff5e6ab7-ec2b-46dd-b050-f4b9bceff071"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:35.781526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d6c6efea-6286-4b6a-9a1c-48fe49008748 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 0.296268 Aug 05 20:46:35.782306 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 172/336] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:35 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:35.784087 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-8eb01aea-d4e5-4372-bc50-d678f2bd2dc8 req-7b5b5a92-a54b-4847-9601-6154e7913af2 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:35.784573 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-8eb01aea-d4e5-4372-bc50-d678f2bd2dc8 req-7b5b5a92-a54b-4847-9601-6154e7913af2 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:35.785137 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-8eb01aea-d4e5-4372-bc50-d678f2bd2dc8 req-7b5b5a92-a54b-4847-9601-6154e7913af2 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:35.800481 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-8eb01aea-d4e5-4372-bc50-d678f2bd2dc8 req-7b5b5a92-a54b-4847-9601-6154e7913af2 service nova] Creating event network-changed:ff5e6ab7-ec2b-46dd-b050-f4b9bceff071 for instance a270d6db-218c-4081-81b9-b161dc70a7bb on hv-cinder-85220 Aug 05 20:46:35.806634 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-8eb01aea-d4e5-4372-bc50-d678f2bd2dc8 req-7b5b5a92-a54b-4847-9601-6154e7913af2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035897 Aug 05 20:46:35.807511 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 165/337] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:46:35.988081 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c1d5ef1f-fa03-487b-b89e-08bb584a9b06 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:35.988677 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c1d5ef1f-fa03-487b-b89e-08bb584a9b06 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:35.995646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c1d5ef1f-fa03-487b-b89e-08bb584a9b06 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:35.996135 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c1d5ef1f-fa03-487b-b89e-08bb584a9b06 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:35.996566 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c1d5ef1f-fa03-487b-b89e-08bb584a9b06 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:35.997263 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c1d5ef1f-fa03-487b-b89e-08bb584a9b06 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:35.997714 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c1d5ef1f-fa03-487b-b89e-08bb584a9b06 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:35.998121 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c1d5ef1f-fa03-487b-b89e-08bb584a9b06 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:36.008312 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e81bb63d-ef94-4f87-87e2-d5fc409e19a0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:36.009826 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e81bb63d-ef94-4f87-87e2-d5fc409e19a0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:36.012290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:36.019288 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e81bb63d-ef94-4f87-87e2-d5fc409e19a0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:36.020020 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e81bb63d-ef94-4f87-87e2-d5fc409e19a0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:36.020461 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e81bb63d-ef94-4f87-87e2-d5fc409e19a0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:36.021175 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e81bb63d-ef94-4f87-87e2-d5fc409e19a0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:36.021630 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e81bb63d-ef94-4f87-87e2-d5fc409e19a0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:36.022057 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e81bb63d-ef94-4f87-87e2-d5fc409e19a0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:36.251118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c1d5ef1f-fa03-487b-b89e-08bb584a9b06 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:36.255573 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-e81bb63d-ef94-4f87-87e2-d5fc409e19a0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:36.260401 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c1d5ef1f-fa03-487b-b89e-08bb584a9b06 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:36.261983 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c1d5ef1f-fa03-487b-b89e-08bb584a9b06 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:36.263509 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c1d5ef1f-fa03-487b-b89e-08bb584a9b06 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1742 microversion: 2.20 time: 0.281138 Aug 05 20:46:36.263936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e81bb63d-ef94-4f87-87e2-d5fc409e19a0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1712 microversion: 2.1 time: 0.259899 Aug 05 20:46:36.264623 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 173/338] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:35 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1742 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:36.264895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 166/339] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:36 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1712 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:36.486674 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2ee5b2ea-f4b5-42eb-807d-624e214cccf4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:36.487340 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2ee5b2ea-f4b5-42eb-807d-624e214cccf4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:36.495727 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ee5b2ea-f4b5-42eb-807d-624e214cccf4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:36.496205 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ee5b2ea-f4b5-42eb-807d-624e214cccf4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:36.496675 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ee5b2ea-f4b5-42eb-807d-624e214cccf4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:36.497385 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ee5b2ea-f4b5-42eb-807d-624e214cccf4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:36.497925 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ee5b2ea-f4b5-42eb-807d-624e214cccf4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:36.498357 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ee5b2ea-f4b5-42eb-807d-624e214cccf4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:36.509402 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-cf237751-1962-4444-b71f-0a604a8b00f3 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:36.511420 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-cf237751-1962-4444-b71f-0a604a8b00f3 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:36.521948 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cf237751-1962-4444-b71f-0a604a8b00f3 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:36.523097 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cf237751-1962-4444-b71f-0a604a8b00f3 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:36.524075 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cf237751-1962-4444-b71f-0a604a8b00f3 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:36.525048 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cf237751-1962-4444-b71f-0a604a8b00f3 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:36.526171 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cf237751-1962-4444-b71f-0a604a8b00f3 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:36.526851 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cf237751-1962-4444-b71f-0a604a8b00f3 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:37.226199 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2ee5b2ea-f4b5-42eb-807d-624e214cccf4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:37.234107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2ee5b2ea-f4b5-42eb-807d-624e214cccf4 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1508 microversion: 2.1 time: 0.751695 Aug 05 20:46:37.234645 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 174/340] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:36 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1508 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:37.239720 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8f147702-c7f8-446e-a43c-404153111d1e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:37.240496 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8f147702-c7f8-446e-a43c-404153111d1e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:37.240870 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-cf237751-1962-4444-b71f-0a604a8b00f3 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:37.247339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f147702-c7f8-446e-a43c-404153111d1e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:37.248104 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f147702-c7f8-446e-a43c-404153111d1e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:37.248722 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f147702-c7f8-446e-a43c-404153111d1e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:37.249801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f147702-c7f8-446e-a43c-404153111d1e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:37.250253 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f147702-c7f8-446e-a43c-404153111d1e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:37.250645 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f147702-c7f8-446e-a43c-404153111d1e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:37.251248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-cf237751-1962-4444-b71f-0a604a8b00f3 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.748567 Aug 05 20:46:37.252209 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 167/341] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:36 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:37.257435 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0a6e651d-472d-45c4-baf1-54bb1fb229bc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:37.258148 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0a6e651d-472d-45c4-baf1-54bb1fb229bc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:37.268622 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0a6e651d-472d-45c4-baf1-54bb1fb229bc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:37.269214 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0a6e651d-472d-45c4-baf1-54bb1fb229bc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:37.269695 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0a6e651d-472d-45c4-baf1-54bb1fb229bc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:37.271161 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0a6e651d-472d-45c4-baf1-54bb1fb229bc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:37.271756 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0a6e651d-472d-45c4-baf1-54bb1fb229bc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:37.272192 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0a6e651d-472d-45c4-baf1-54bb1fb229bc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:37.697440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8f147702-c7f8-446e-a43c-404153111d1e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:37.709269 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0a6e651d-472d-45c4-baf1-54bb1fb229bc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:37.717672 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0a6e651d-472d-45c4-baf1-54bb1fb229bc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1371 microversion: 2.1 time: 0.463934 Aug 05 20:46:37.718125 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8f147702-c7f8-446e-a43c-404153111d1e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.482152 Aug 05 20:46:37.718796 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 168/342] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:37 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1371 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:37.720547 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 175/343] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:37 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:37.724114 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4c7be7c9-883d-4268-a53f-30b1e4f8c39c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:37.725212 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0c8ed584-7c4d-4550-a0fa-5be1ff1603c4 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:37.725447 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4c7be7c9-883d-4268-a53f-30b1e4f8c39c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:37.725825 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0c8ed584-7c4d-4550-a0fa-5be1ff1603c4 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:37.732374 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4c7be7c9-883d-4268-a53f-30b1e4f8c39c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:37.733068 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4c7be7c9-883d-4268-a53f-30b1e4f8c39c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:37.733630 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0c8ed584-7c4d-4550-a0fa-5be1ff1603c4 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:37.733939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4c7be7c9-883d-4268-a53f-30b1e4f8c39c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:37.735328 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4c7be7c9-883d-4268-a53f-30b1e4f8c39c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:37.736401 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4c7be7c9-883d-4268-a53f-30b1e4f8c39c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:37.737017 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0c8ed584-7c4d-4550-a0fa-5be1ff1603c4 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:37.737340 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4c7be7c9-883d-4268-a53f-30b1e4f8c39c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:37.737510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0c8ed584-7c4d-4550-a0fa-5be1ff1603c4 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:37.738263 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0c8ed584-7c4d-4550-a0fa-5be1ff1603c4 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:37.746901 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0c8ed584-7c4d-4550-a0fa-5be1ff1603c4 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:37.747351 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0c8ed584-7c4d-4550-a0fa-5be1ff1603c4 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:38.072196 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4c7be7c9-883d-4268-a53f-30b1e4f8c39c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:38.081407 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4c7be7c9-883d-4268-a53f-30b1e4f8c39c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:38.082990 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4c7be7c9-883d-4268-a53f-30b1e4f8c39c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:38.084217 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4c7be7c9-883d-4268-a53f-30b1e4f8c39c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1724 microversion: 2.20 time: 0.364259 Aug 05 20:46:38.084763 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 169/344] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:37 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:38.086622 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0c8ed584-7c4d-4550-a0fa-5be1ff1603c4 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:38.089227 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-38eb8f7f-9132-40b4-ace4-e4e9d1b2a4a0 req-1ff6a8c5-4ec7-4ca8-a416-34a18c678c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef44444-a6d8-49fd-8e77-0a9bb347fd1a", "name": "network-vif-deleted", "tag": "796128a9-b6c9-4059-b594-b45eebcaa851"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:38.100076 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-38eb8f7f-9132-40b4-ace4-e4e9d1b2a4a0 req-1ff6a8c5-4ec7-4ca8-a416-34a18c678c97 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:38.100557 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-38eb8f7f-9132-40b4-ace4-e4e9d1b2a4a0 req-1ff6a8c5-4ec7-4ca8-a416-34a18c678c97 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:38.101005 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-38eb8f7f-9132-40b4-ace4-e4e9d1b2a4a0 req-1ff6a8c5-4ec7-4ca8-a416-34a18c678c97 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:38.105875 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0c8ed584-7c4d-4550-a0fa-5be1ff1603c4 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1712 microversion: 2.1 time: 0.383930 Aug 05 20:46:38.106628 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 176/345] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:37 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1712 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:38.114820 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-38eb8f7f-9132-40b4-ace4-e4e9d1b2a4a0 req-1ff6a8c5-4ec7-4ca8-a416-34a18c678c97 service nova] Creating event network-vif-deleted:796128a9-b6c9-4059-b594-b45eebcaa851 for instance 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a on hv-cinder-85220 Aug 05 20:46:38.121343 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-38eb8f7f-9132-40b4-ace4-e4e9d1b2a4a0 req-1ff6a8c5-4ec7-4ca8-a416-34a18c678c97 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035497 Aug 05 20:46:38.121942 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 170/346] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:46:38.257276 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-180e83ae-b096-4e22-b4aa-63c62fb06481 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:38.257896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-180e83ae-b096-4e22-b4aa-63c62fb06481 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:38.265595 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-180e83ae-b096-4e22-b4aa-63c62fb06481 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:38.266107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-180e83ae-b096-4e22-b4aa-63c62fb06481 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:38.266623 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-180e83ae-b096-4e22-b4aa-63c62fb06481 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:38.267775 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-180e83ae-b096-4e22-b4aa-63c62fb06481 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:38.268947 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-180e83ae-b096-4e22-b4aa-63c62fb06481 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:38.269383 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-180e83ae-b096-4e22-b4aa-63c62fb06481 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:38.275762 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-254881b0-5500-4b6e-8aa4-21ac6ff53c1f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:38.276535 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-254881b0-5500-4b6e-8aa4-21ac6ff53c1f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:38.284084 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-254881b0-5500-4b6e-8aa4-21ac6ff53c1f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:38.284907 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-254881b0-5500-4b6e-8aa4-21ac6ff53c1f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:38.285358 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-254881b0-5500-4b6e-8aa4-21ac6ff53c1f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:38.286252 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-254881b0-5500-4b6e-8aa4-21ac6ff53c1f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:38.286548 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-254881b0-5500-4b6e-8aa4-21ac6ff53c1f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:38.288853 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-254881b0-5500-4b6e-8aa4-21ac6ff53c1f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:38.365323 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-180e83ae-b096-4e22-b4aa-63c62fb06481 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:38.373057 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-180e83ae-b096-4e22-b4aa-63c62fb06481 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1466 microversion: 2.1 time: 0.120457 Aug 05 20:46:38.373632 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 177/347] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:38 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1466 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:38.432775 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-254881b0-5500-4b6e-8aa4-21ac6ff53c1f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:38.444182 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-254881b0-5500-4b6e-8aa4-21ac6ff53c1f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.173056 Aug 05 20:46:38.444898 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 171/348] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:38 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:38.745531 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8cf49c09-b60a-45a9-91ee-eb4682d010ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:38.746978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8cf49c09-b60a-45a9-91ee-eb4682d010ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:38.751030 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-be576c73-afba-465e-9248-8b58bbedbf0b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:38.752062 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-be576c73-afba-465e-9248-8b58bbedbf0b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:38.756440 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8cf49c09-b60a-45a9-91ee-eb4682d010ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:38.756956 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8cf49c09-b60a-45a9-91ee-eb4682d010ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:38.757393 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8cf49c09-b60a-45a9-91ee-eb4682d010ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:38.758232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8cf49c09-b60a-45a9-91ee-eb4682d010ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:38.758693 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8cf49c09-b60a-45a9-91ee-eb4682d010ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:38.758848 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be576c73-afba-465e-9248-8b58bbedbf0b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:38.759116 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8cf49c09-b60a-45a9-91ee-eb4682d010ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:38.759293 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be576c73-afba-465e-9248-8b58bbedbf0b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:38.759811 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be576c73-afba-465e-9248-8b58bbedbf0b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:38.760519 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be576c73-afba-465e-9248-8b58bbedbf0b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:38.760972 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be576c73-afba-465e-9248-8b58bbedbf0b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:38.761402 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be576c73-afba-465e-9248-8b58bbedbf0b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:38.963959 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8cf49c09-b60a-45a9-91ee-eb4682d010ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:38.968983 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-be576c73-afba-465e-9248-8b58bbedbf0b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:38.971295 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:38.977975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8cf49c09-b60a-45a9-91ee-eb4682d010ee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.239310 Aug 05 20:46:38.978744 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 172/349] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:38 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:38.979980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-be576c73-afba-465e-9248-8b58bbedbf0b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1560 microversion: 2.1 time: 0.243256 Aug 05 20:46:38.981060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 178/350] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:38 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1560 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:39.001494 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ce38a7fc-7ef2-4e53-9fa2-28421560f204 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:39.002185 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ce38a7fc-7ef2-4e53-9fa2-28421560f204 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:39.009092 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce38a7fc-7ef2-4e53-9fa2-28421560f204 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:39.009572 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce38a7fc-7ef2-4e53-9fa2-28421560f204 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:39.009984 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce38a7fc-7ef2-4e53-9fa2-28421560f204 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:39.010825 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce38a7fc-7ef2-4e53-9fa2-28421560f204 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:39.011269 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce38a7fc-7ef2-4e53-9fa2-28421560f204 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:39.011726 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce38a7fc-7ef2-4e53-9fa2-28421560f204 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:39.016836 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=100 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:39.076848 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-a67a0b5b-503e-4e5e-93d5-2fbef9276be8 req-077d3d4f-5892-414a-b71f-08fd877be8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20537f07-e2b8-4c88-8757-58c0b37570d2", "name": "network-vif-unplugged", "status": "completed", "tag": "a196cd1a-7fd3-4c91-8b4f-d500d0c2740a"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:39.094535 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a67a0b5b-503e-4e5e-93d5-2fbef9276be8 req-077d3d4f-5892-414a-b71f-08fd877be8af service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:39.094535 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a67a0b5b-503e-4e5e-93d5-2fbef9276be8 req-077d3d4f-5892-414a-b71f-08fd877be8af service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:39.094535 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a67a0b5b-503e-4e5e-93d5-2fbef9276be8 req-077d3d4f-5892-414a-b71f-08fd877be8af service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:39.112868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ce38a7fc-7ef2-4e53-9fa2-28421560f204 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115231 Aug 05 20:46:39.114310 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 173/351] 10.222.0.100 () {58 vars in 1280 bytes} [Fri Aug 5 20:46:38 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:46:39.119880 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-af453c90-aec3-48d5-9f0a-12c2d096d43f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:39.126277 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-a67a0b5b-503e-4e5e-93d5-2fbef9276be8 req-077d3d4f-5892-414a-b71f-08fd877be8af service nova] Creating event network-vif-unplugged:a196cd1a-7fd3-4c91-8b4f-d500d0c2740a for instance 20537f07-e2b8-4c88-8757-58c0b37570d2 on hv-cinder-85220 Aug 05 20:46:39.131571 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-a67a0b5b-503e-4e5e-93d5-2fbef9276be8 req-077d3d4f-5892-414a-b71f-08fd877be8af service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058991 Aug 05 20:46:39.132493 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 179/352] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:46:39.133350 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-af453c90-aec3-48d5-9f0a-12c2d096d43f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:39.137634 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9bb66b5e-8083-4936-af4c-4b4047b0caab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:39.138357 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9bb66b5e-8083-4936-af4c-4b4047b0caab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:39.145754 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9bb66b5e-8083-4936-af4c-4b4047b0caab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:39.146256 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9bb66b5e-8083-4936-af4c-4b4047b0caab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:39.146691 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9bb66b5e-8083-4936-af4c-4b4047b0caab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:39.147613 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9bb66b5e-8083-4936-af4c-4b4047b0caab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:39.149284 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9bb66b5e-8083-4936-af4c-4b4047b0caab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:39.149528 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-af453c90-aec3-48d5-9f0a-12c2d096d43f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:39.150070 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9bb66b5e-8083-4936-af4c-4b4047b0caab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:39.150206 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-af453c90-aec3-48d5-9f0a-12c2d096d43f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:39.150719 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-af453c90-aec3-48d5-9f0a-12c2d096d43f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:39.151740 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-af453c90-aec3-48d5-9f0a-12c2d096d43f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:39.152350 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-af453c90-aec3-48d5-9f0a-12c2d096d43f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:39.152910 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-af453c90-aec3-48d5-9f0a-12c2d096d43f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:39.349726 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9bb66b5e-8083-4936-af4c-4b4047b0caab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:39.359383 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9bb66b5e-8083-4936-af4c-4b4047b0caab tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1716 microversion: 2.1 time: 0.225652 Aug 05 20:46:39.363427 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-af453c90-aec3-48d5-9f0a-12c2d096d43f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:39.371923 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 180/353] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:39 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1716 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:39.372780 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-af453c90-aec3-48d5-9f0a-12c2d096d43f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:39.374650 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-af453c90-aec3-48d5-9f0a-12c2d096d43f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:39.376055 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-af453c90-aec3-48d5-9f0a-12c2d096d43f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1724 microversion: 2.20 time: 0.260591 Aug 05 20:46:39.376736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 174/354] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:39 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:39.394229 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9957564c-31b4-4bac-babb-ad636ecdfb6f tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:39.395017 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9957564c-31b4-4bac-babb-ad636ecdfb6f tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:39.401142 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9957564c-31b4-4bac-babb-ad636ecdfb6f tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:39.401627 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9957564c-31b4-4bac-babb-ad636ecdfb6f tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:39.402060 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9957564c-31b4-4bac-babb-ad636ecdfb6f tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:39.402756 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9957564c-31b4-4bac-babb-ad636ecdfb6f tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:39.403210 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9957564c-31b4-4bac-babb-ad636ecdfb6f tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:39.403698 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9957564c-31b4-4bac-babb-ad636ecdfb6f tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:39.466923 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9957564c-31b4-4bac-babb-ad636ecdfb6f tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:39.468935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8ec7b869-881e-459f-a022-055d2feb34ae tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:39.469632 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8ec7b869-881e-459f-a022-055d2feb34ae tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:39.475438 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9957564c-31b4-4bac-babb-ad636ecdfb6f tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1466 microversion: 2.1 time: 0.085212 Aug 05 20:46:39.475902 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8ec7b869-881e-459f-a022-055d2feb34ae tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:39.476423 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 181/355] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:39 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1466 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:39.476555 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8ec7b869-881e-459f-a022-055d2feb34ae tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:39.477021 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8ec7b869-881e-459f-a022-055d2feb34ae tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:39.477811 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8ec7b869-881e-459f-a022-055d2feb34ae tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:39.478331 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8ec7b869-881e-459f-a022-055d2feb34ae tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:39.478821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8ec7b869-881e-459f-a022-055d2feb34ae tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:39.628848 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8ec7b869-881e-459f-a022-055d2feb34ae tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:39.636858 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8ec7b869-881e-459f-a022-055d2feb34ae tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.171900 Aug 05 20:46:39.637430 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 175/356] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:39 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:39.999659 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-016b4820-de2f-413d-833b-50526b20c16e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:40.000271 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-016b4820-de2f-413d-833b-50526b20c16e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:40.008512 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-016b4820-de2f-413d-833b-50526b20c16e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:40.009197 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-016b4820-de2f-413d-833b-50526b20c16e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:40.009587 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-016b4820-de2f-413d-833b-50526b20c16e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:40.010309 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-016b4820-de2f-413d-833b-50526b20c16e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:40.010764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-016b4820-de2f-413d-833b-50526b20c16e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:40.011195 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-016b4820-de2f-413d-833b-50526b20c16e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:40.116963 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-3f3e56f7-5aec-47a2-a7a4-cb2865bb52e0 req-29a08cfc-1c41-4199-8393-24a71f9c41cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784e7d44-0869-48e1-84f5-e35567f73947", "tag": "71f59c3d-04cf-4aa9-981a-c0db0c85c972"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:40.131010 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-3f3e56f7-5aec-47a2-a7a4-cb2865bb52e0 req-29a08cfc-1c41-4199-8393-24a71f9c41cf service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:40.140131 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-3f3e56f7-5aec-47a2-a7a4-cb2865bb52e0 req-29a08cfc-1c41-4199-8393-24a71f9c41cf service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:40.140745 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-3f3e56f7-5aec-47a2-a7a4-cb2865bb52e0 req-29a08cfc-1c41-4199-8393-24a71f9c41cf service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:40.162813 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-3f3e56f7-5aec-47a2-a7a4-cb2865bb52e0 req-29a08cfc-1c41-4199-8393-24a71f9c41cf service nova] Creating event network-changed:71f59c3d-04cf-4aa9-981a-c0db0c85c972 for instance 784e7d44-0869-48e1-84f5-e35567f73947 on hv-cinder-85220 Aug 05 20:46:40.168336 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-3f3e56f7-5aec-47a2-a7a4-cb2865bb52e0 req-29a08cfc-1c41-4199-8393-24a71f9c41cf service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055888 Aug 05 20:46:40.169109 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 176/357] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:46:40.204946 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-016b4820-de2f-413d-833b-50526b20c16e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:40.214269 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-016b4820-de2f-413d-833b-50526b20c16e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.218553 Aug 05 20:46:40.214882 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 182/358] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:39 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:40.400448 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-775c58fd-716b-41a5-826f-acb2b00b21e1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:40.401142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-775c58fd-716b-41a5-826f-acb2b00b21e1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:40.408323 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-775c58fd-716b-41a5-826f-acb2b00b21e1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:40.409249 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-775c58fd-716b-41a5-826f-acb2b00b21e1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:40.414124 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-775c58fd-716b-41a5-826f-acb2b00b21e1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:40.415170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-775c58fd-716b-41a5-826f-acb2b00b21e1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:40.415655 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-775c58fd-716b-41a5-826f-acb2b00b21e1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:40.416297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-775c58fd-716b-41a5-826f-acb2b00b21e1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:40.498413 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9d351fd0-f6f2-4200-acec-3d6d19b08581 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:40.499490 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9d351fd0-f6f2-4200-acec-3d6d19b08581 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:40.505989 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9d351fd0-f6f2-4200-acec-3d6d19b08581 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:40.506674 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9d351fd0-f6f2-4200-acec-3d6d19b08581 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:40.507099 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9d351fd0-f6f2-4200-acec-3d6d19b08581 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:40.508016 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9d351fd0-f6f2-4200-acec-3d6d19b08581 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:40.508782 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9d351fd0-f6f2-4200-acec-3d6d19b08581 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:40.509411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9d351fd0-f6f2-4200-acec-3d6d19b08581 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:40.565551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-775c58fd-716b-41a5-826f-acb2b00b21e1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:40.574025 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-775c58fd-716b-41a5-826f-acb2b00b21e1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:40.576317 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-775c58fd-716b-41a5-826f-acb2b00b21e1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:40.577599 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-775c58fd-716b-41a5-826f-acb2b00b21e1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1724 microversion: 2.20 time: 0.182035 Aug 05 20:46:40.578295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 177/359] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:40 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:40.587252 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9d351fd0-f6f2-4200-acec-3d6d19b08581 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053d69835219410f9a669f3afd120263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e909b98552a841c988e49b79ba01fa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:40.594996 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9d351fd0-f6f2-4200-acec-3d6d19b08581 tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 200 len: 1303 microversion: 2.1 time: 0.100518 Aug 05 20:46:40.595822 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 183/360] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:40 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:40.658868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1bd8b15e-bdde-4c12-aa63-661d0e5ccad2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:40.659663 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-1bd8b15e-bdde-4c12-aa63-661d0e5ccad2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:40.675988 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1bd8b15e-bdde-4c12-aa63-661d0e5ccad2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:40.677535 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1bd8b15e-bdde-4c12-aa63-661d0e5ccad2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:40.679174 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1bd8b15e-bdde-4c12-aa63-661d0e5ccad2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:40.680250 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1bd8b15e-bdde-4c12-aa63-661d0e5ccad2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:40.681192 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1bd8b15e-bdde-4c12-aa63-661d0e5ccad2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:40.681965 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1bd8b15e-bdde-4c12-aa63-661d0e5ccad2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:40.899380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-1bd8b15e-bdde-4c12-aa63-661d0e5ccad2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:40.911795 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-1bd8b15e-bdde-4c12-aa63-661d0e5ccad2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.257757 Aug 05 20:46:40.912403 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 178/361] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:40 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:41.236754 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6ec0364d-5e1f-4c8b-8ed9-81a2ad629c4e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:41.237447 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6ec0364d-5e1f-4c8b-8ed9-81a2ad629c4e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:41.245836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6ec0364d-5e1f-4c8b-8ed9-81a2ad629c4e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:41.246255 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6ec0364d-5e1f-4c8b-8ed9-81a2ad629c4e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:41.246696 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6ec0364d-5e1f-4c8b-8ed9-81a2ad629c4e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:41.247424 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6ec0364d-5e1f-4c8b-8ed9-81a2ad629c4e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:41.247878 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6ec0364d-5e1f-4c8b-8ed9-81a2ad629c4e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:41.248358 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6ec0364d-5e1f-4c8b-8ed9-81a2ad629c4e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:41.391781 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6ec0364d-5e1f-4c8b-8ed9-81a2ad629c4e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:41.399885 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6ec0364d-5e1f-4c8b-8ed9-81a2ad629c4e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.167780 Aug 05 20:46:41.400396 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 184/362] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:41 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:41.602352 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-765e2a60-c62b-44d9-8332-2ddb786313c7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:41.602854 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-765e2a60-c62b-44d9-8332-2ddb786313c7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:41.610249 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-765e2a60-c62b-44d9-8332-2ddb786313c7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:41.610829 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-765e2a60-c62b-44d9-8332-2ddb786313c7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:41.611506 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-765e2a60-c62b-44d9-8332-2ddb786313c7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:41.612209 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-765e2a60-c62b-44d9-8332-2ddb786313c7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:41.612810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-765e2a60-c62b-44d9-8332-2ddb786313c7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:41.613240 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-765e2a60-c62b-44d9-8332-2ddb786313c7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:41.616755 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-80a14b78-1830-47bb-af94-f67d2fb401ef tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:41.617378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-80a14b78-1830-47bb-af94-f67d2fb401ef tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] [instance: 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:41.624281 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-80a14b78-1830-47bb-af94-f67d2fb401ef tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:41.625573 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-80a14b78-1830-47bb-af94-f67d2fb401ef tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:41.626196 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-80a14b78-1830-47bb-af94-f67d2fb401ef tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:41.627380 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-80a14b78-1830-47bb-af94-f67d2fb401ef tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:41.628130 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-80a14b78-1830-47bb-af94-f67d2fb401ef tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:41.628813 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-80a14b78-1830-47bb-af94-f67d2fb401ef tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:41.644156 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-80a14b78-1830-47bb-af94-f67d2fb401ef tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] HTTP exception thrown: Instance 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a could not be found. Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-80a14b78-1830-47bb-af94-f67d2fb401ef tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Request method failure captured: Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a HTTP/1.1 Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YFssqhvQWpgxHc3XBka6vgALjEBVCniOjAorT-WWFxJ96ivbi1Um-XXokP_6Q_UG2DoBKdmrJscH02LHb7ODuOiEymXcu8qBZ38sAO6yGoOefzxAifVY7sYY3tItfFL9yFKnZDPscNyLBYPS344U4W3p9WHJ_1F5IqlBTU1RRykv_E Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: e909b98552a841c988e49b79ba01fa64 Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesActionsTest-493479436 Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:46:41.645834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:46:41.647446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e909b98552a841c988e49b79ba01fa64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/e909b98552a841c988e49b79ba01fa64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/e909b98552a841c988e49b79ba01fa64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_e909b98552a841c988e49b79ba01fa64", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:46:41.647446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesActionsTest-493479436 Aug 05 20:46:41.647446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: e909b98552a841c988e49b79ba01fa64 Aug 05 20:46:41.647446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesActionsTest-493479436 Aug 05 20:46:41.647446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesActionsTest-493479436-project Aug 05 20:46:41.647446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:46:41.647446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:46:41.647446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 053d69835219410f9a669f3afd120263 Aug 05 20:46:41.647446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesActionsTest-493479436-project Aug 05 20:46:41.647446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:46:41.647446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a could not be found. Aug 05 20:46:41.647446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '1ef44444-a6d8-49fd-8e77-0a9bb347fd1a'} Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a could not be found. Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:46:41.648239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a could not be found. Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a could not be found. Aug 05 20:46:41.649563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:46:41.650601 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-80a14b78-1830-47bb-af94-f67d2fb401ef tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] Returning 404 to user: Instance 1ef44444-a6d8-49fd-8e77-0a9bb347fd1a could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:46:41.650601 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-80a14b78-1830-47bb-af94-f67d2fb401ef tempest-VolumesActionsTest-493479436 tempest-VolumesActionsTest-493479436-project] 10.222.0.100 "GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a" status: 404 len: 111 microversion: 2.1 time: 0.035067 Aug 05 20:46:41.650601 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 185/363] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:41 2022] GET /compute/v2.1/servers/1ef44444-a6d8-49fd-8e77-0a9bb347fd1a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:46:41.763869 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-765e2a60-c62b-44d9-8332-2ddb786313c7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:41.772778 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-765e2a60-c62b-44d9-8332-2ddb786313c7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:41.774334 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-765e2a60-c62b-44d9-8332-2ddb786313c7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:41.775554 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-765e2a60-c62b-44d9-8332-2ddb786313c7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1667 microversion: 2.20 time: 0.177940 Aug 05 20:46:41.776111 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 179/364] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:41 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1667 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:41.799376 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1c310a60-7cbf-4876-87dd-6f5163cde9e4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8e15517-0f2e-4c18-8182-da06aab1ac3c"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:41.802443 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1c310a60-7cbf-4876-87dd-6f5163cde9e4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:41.808959 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c310a60-7cbf-4876-87dd-6f5163cde9e4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:41.809446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c310a60-7cbf-4876-87dd-6f5163cde9e4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:41.809992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c310a60-7cbf-4876-87dd-6f5163cde9e4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:41.810693 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c310a60-7cbf-4876-87dd-6f5163cde9e4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:41.811141 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c310a60-7cbf-4876-87dd-6f5163cde9e4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:41.811591 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c310a60-7cbf-4876-87dd-6f5163cde9e4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:41.932951 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-b28367da-b117-4140-bf53-e089282209e7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:41.933574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-b28367da-b117-4140-bf53-e089282209e7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:41.939732 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b28367da-b117-4140-bf53-e089282209e7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:41.940868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b28367da-b117-4140-bf53-e089282209e7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:41.941339 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b28367da-b117-4140-bf53-e089282209e7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:41.942051 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b28367da-b117-4140-bf53-e089282209e7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:41.942510 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b28367da-b117-4140-bf53-e089282209e7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:41.942931 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b28367da-b117-4140-bf53-e089282209e7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:42.108706 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-b28367da-b117-4140-bf53-e089282209e7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:42.118891 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-b28367da-b117-4140-bf53-e089282209e7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.189784 Aug 05 20:46:42.119825 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 180/365] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:41 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:42.141360 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1c310a60-7cbf-4876-87dd-6f5163cde9e4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "POST /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.346134 Aug 05 20:46:42.142090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 186/366] 10.222.0.100 () {62 vars in 1369 bytes} [Fri Aug 5 20:46:41 2022] POST /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/os-volume_attachments => generated 188 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:46:42.288735 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8bee1642-62e8-4870-b325-91464f6fc552 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:42.289428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8bee1642-62e8-4870-b325-91464f6fc552 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:42.296312 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8bee1642-62e8-4870-b325-91464f6fc552 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:42.296867 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8bee1642-62e8-4870-b325-91464f6fc552 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:42.297370 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8bee1642-62e8-4870-b325-91464f6fc552 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:42.298142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8bee1642-62e8-4870-b325-91464f6fc552 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:42.298707 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8bee1642-62e8-4870-b325-91464f6fc552 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:42.299329 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8bee1642-62e8-4870-b325-91464f6fc552 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:42.300926 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1688222111", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-31510839", "security_groups": [{"name": "tempest-secgroup-smoke-658125069"}], "networks": [{"uuid": "cd6bdd69-45c0-4c79-bd2b-fd0dcd955af6"}], "block_device_mapping_v2": [{"uuid": "9c8a6c1f-ee46-405f-892a-6fe79796a9af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:42.346087 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8bee1642-62e8-4870-b325-91464f6fc552 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124431) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 20:46:42.426826 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] validate_networks() for [('cd6bdd69-45c0-4c79-bd2b-fd0dcd955af6', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:46:42.431882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8bee1642-62e8-4870-b325-91464f6fc552 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "POST /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/action" status: 202 len: 0 microversion: 2.20 time: 0.147001 Aug 05 20:46:42.432497 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 181/367] 10.222.0.100 () {62 vars in 1324 bytes} [Fri Aug 5 20:46:42 2022] POST /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:46:42.437224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-12568ec9-e522-4833-ac1d-240f0cee3401 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:42.437839 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-12568ec9-e522-4833-ac1d-240f0cee3401 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:42.444745 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-12568ec9-e522-4833-ac1d-240f0cee3401 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:42.445246 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-12568ec9-e522-4833-ac1d-240f0cee3401 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:42.446064 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-12568ec9-e522-4833-ac1d-240f0cee3401 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:42.446460 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-12568ec9-e522-4833-ac1d-240f0cee3401 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:42.446859 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-12568ec9-e522-4833-ac1d-240f0cee3401 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:42.447212 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-12568ec9-e522-4833-ac1d-240f0cee3401 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:42.675019 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-12568ec9-e522-4833-ac1d-240f0cee3401 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:42.692800 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-12568ec9-e522-4833-ac1d-240f0cee3401 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.249762 Aug 05 20:46:42.700360 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 182/368] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:42 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:42.705752 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-dd59394b-2b6c-49f5-8156-9de67d1a4213 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:42.709705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-dd59394b-2b6c-49f5-8156-9de67d1a4213 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:42.720090 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dd59394b-2b6c-49f5-8156-9de67d1a4213 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:42.720629 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dd59394b-2b6c-49f5-8156-9de67d1a4213 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:42.728362 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dd59394b-2b6c-49f5-8156-9de67d1a4213 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:42.729235 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dd59394b-2b6c-49f5-8156-9de67d1a4213 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:42.729715 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dd59394b-2b6c-49f5-8156-9de67d1a4213 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:42.730150 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dd59394b-2b6c-49f5-8156-9de67d1a4213 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:42.992325 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-dd59394b-2b6c-49f5-8156-9de67d1a4213 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:43.001203 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-dd59394b-2b6c-49f5-8156-9de67d1a4213 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:43.002760 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-dd59394b-2b6c-49f5-8156-9de67d1a4213 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:43.003971 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-dd59394b-2b6c-49f5-8156-9de67d1a4213 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1753 microversion: 2.20 time: 0.302316 Aug 05 20:46:43.015377 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 183/369] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:42 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1753 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:43.039940 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:46:43.040591 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:46:43.040942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:46:43.041442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:46:43.042075 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:46:43.051677 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:43.052229 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:43.052782 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:43.053592 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:43.054104 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:43.054582 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:43.072257 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Getting quotas for project 14277b321e0043f9a0846cc4949465c7. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:46:43.076590 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Getting quotas for user 9808a95e377143e2a77547c14e7932a4 and project 14277b321e0043f9a0846cc4949465c7. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:46:43.135199 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:46:43.137632 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c8a6c1f-ee46-405f-892a-6fe79796a9af',volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:46:43.143968 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3830401c-5ee2-4bdf-8d5b-8193dda97b95 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:43.144606 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3830401c-5ee2-4bdf-8d5b-8193dda97b95 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:43.150703 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3830401c-5ee2-4bdf-8d5b-8193dda97b95 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:43.151178 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3830401c-5ee2-4bdf-8d5b-8193dda97b95 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:43.151866 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3830401c-5ee2-4bdf-8d5b-8193dda97b95 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:43.152651 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3830401c-5ee2-4bdf-8d5b-8193dda97b95 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:43.153470 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3830401c-5ee2-4bdf-8d5b-8193dda97b95 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:43.154072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3830401c-5ee2-4bdf-8d5b-8193dda97b95 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:43.294983 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3830401c-5ee2-4bdf-8d5b-8193dda97b95 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:43.303985 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3830401c-5ee2-4bdf-8d5b-8193dda97b95 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.164526 Aug 05 20:46:43.304563 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 184/370] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:43 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:43.305436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ad281367-ea65-4b3e-955e-f9b65ae71184 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.009057 Aug 05 20:46:43.306078 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 187/371] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:46:42 2022] POST /compute/v2.1/servers => generated 407 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 05 20:46:43.316630 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3370b261-c1bf-4d9c-9ce0-2314d99b9fbd tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:43.317345 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3370b261-c1bf-4d9c-9ce0-2314d99b9fbd tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:43.378968 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3370b261-c1bf-4d9c-9ce0-2314d99b9fbd tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:43.386410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3370b261-c1bf-4d9c-9ce0-2314d99b9fbd tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1090 microversion: 2.1 time: 0.073566 Aug 05 20:46:43.386979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 185/372] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:43 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1090 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:43.723076 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-36cd9bdf-fd0d-4c0b-867b-cbee740f5f86 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:43.723717 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-36cd9bdf-fd0d-4c0b-867b-cbee740f5f86 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:43.734201 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36cd9bdf-fd0d-4c0b-867b-cbee740f5f86 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:43.734705 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36cd9bdf-fd0d-4c0b-867b-cbee740f5f86 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:43.735144 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36cd9bdf-fd0d-4c0b-867b-cbee740f5f86 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:43.736022 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36cd9bdf-fd0d-4c0b-867b-cbee740f5f86 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:43.736752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36cd9bdf-fd0d-4c0b-867b-cbee740f5f86 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:43.737184 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36cd9bdf-fd0d-4c0b-867b-cbee740f5f86 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:43.888209 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-36cd9bdf-fd0d-4c0b-867b-cbee740f5f86 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:43.896280 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-36cd9bdf-fd0d-4c0b-867b-cbee740f5f86 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.177752 Aug 05 20:46:43.896853 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 188/373] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:43 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:44.026516 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8b70da05-ff2f-4602-b65a-03f956fff050 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:44.027098 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8b70da05-ff2f-4602-b65a-03f956fff050 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:44.034705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8b70da05-ff2f-4602-b65a-03f956fff050 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:44.035188 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8b70da05-ff2f-4602-b65a-03f956fff050 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:44.035654 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8b70da05-ff2f-4602-b65a-03f956fff050 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:44.036340 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8b70da05-ff2f-4602-b65a-03f956fff050 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:44.036788 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8b70da05-ff2f-4602-b65a-03f956fff050 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:44.037203 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8b70da05-ff2f-4602-b65a-03f956fff050 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:44.183431 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8b70da05-ff2f-4602-b65a-03f956fff050 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:44.196147 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8b70da05-ff2f-4602-b65a-03f956fff050 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:44.198502 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8b70da05-ff2f-4602-b65a-03f956fff050 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:44.200234 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8b70da05-ff2f-4602-b65a-03f956fff050 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1753 microversion: 2.20 time: 0.177500 Aug 05 20:46:44.201065 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 186/374] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:44 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:44.325993 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-887a7cb0-dafc-42f9-83c8-e29e0538fd60 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:44.326605 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-887a7cb0-dafc-42f9-83c8-e29e0538fd60 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:44.333769 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-887a7cb0-dafc-42f9-83c8-e29e0538fd60 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:44.334288 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-887a7cb0-dafc-42f9-83c8-e29e0538fd60 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:44.334718 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-887a7cb0-dafc-42f9-83c8-e29e0538fd60 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:44.335417 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-887a7cb0-dafc-42f9-83c8-e29e0538fd60 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:44.335890 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-887a7cb0-dafc-42f9-83c8-e29e0538fd60 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:44.336305 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-887a7cb0-dafc-42f9-83c8-e29e0538fd60 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:44.407689 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1b045605-2604-42a3-8747-b3dc1eb4b05e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:44.408303 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-1b045605-2604-42a3-8747-b3dc1eb4b05e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:44.415208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1b045605-2604-42a3-8747-b3dc1eb4b05e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:44.415754 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1b045605-2604-42a3-8747-b3dc1eb4b05e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:44.416194 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1b045605-2604-42a3-8747-b3dc1eb4b05e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:44.416895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1b045605-2604-42a3-8747-b3dc1eb4b05e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:44.417543 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1b045605-2604-42a3-8747-b3dc1eb4b05e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:44.417941 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1b045605-2604-42a3-8747-b3dc1eb4b05e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:44.499232 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-887a7cb0-dafc-42f9-83c8-e29e0538fd60 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:44.501109 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-1b045605-2604-42a3-8747-b3dc1eb4b05e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:44.508385 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-887a7cb0-dafc-42f9-83c8-e29e0538fd60 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.186430 Aug 05 20:46:44.508971 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 189/375] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:44 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:44.510089 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-1b045605-2604-42a3-8747-b3dc1eb4b05e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1140 microversion: 2.1 time: 0.107137 Aug 05 20:46:44.510838 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 187/376] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:44 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1140 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:44.922051 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e62cd8dd-4ada-4ec1-b0d7-2fce643afdd2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:44.923026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e62cd8dd-4ada-4ec1-b0d7-2fce643afdd2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:44.930863 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e62cd8dd-4ada-4ec1-b0d7-2fce643afdd2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:44.931375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e62cd8dd-4ada-4ec1-b0d7-2fce643afdd2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:44.931823 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e62cd8dd-4ada-4ec1-b0d7-2fce643afdd2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:44.932516 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e62cd8dd-4ada-4ec1-b0d7-2fce643afdd2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:44.932970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e62cd8dd-4ada-4ec1-b0d7-2fce643afdd2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:44.933424 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e62cd8dd-4ada-4ec1-b0d7-2fce643afdd2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:45.077174 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e62cd8dd-4ada-4ec1-b0d7-2fce643afdd2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:45.085184 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e62cd8dd-4ada-4ec1-b0d7-2fce643afdd2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.169233 Aug 05 20:46:45.085914 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 190/377] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:44 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:45.225411 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4942f64a-604e-4a32-982e-77b0146bcd42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:45.225997 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4942f64a-604e-4a32-982e-77b0146bcd42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:45.233328 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4942f64a-604e-4a32-982e-77b0146bcd42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:45.233837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4942f64a-604e-4a32-982e-77b0146bcd42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:45.234279 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4942f64a-604e-4a32-982e-77b0146bcd42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:45.234972 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4942f64a-604e-4a32-982e-77b0146bcd42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:45.235471 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4942f64a-604e-4a32-982e-77b0146bcd42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:45.235898 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4942f64a-604e-4a32-982e-77b0146bcd42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:45.378136 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4942f64a-604e-4a32-982e-77b0146bcd42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:45.388348 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4942f64a-604e-4a32-982e-77b0146bcd42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:45.390133 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4942f64a-604e-4a32-982e-77b0146bcd42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:45.391524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4942f64a-604e-4a32-982e-77b0146bcd42 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1753 microversion: 2.20 time: 0.170006 Aug 05 20:46:45.393250 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 188/378] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:45 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:45.531653 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-59018e3e-7b90-426d-9f48-1252346d8f9d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:45.532469 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-59018e3e-7b90-426d-9f48-1252346d8f9d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:45.535270 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d3450999-0018-44e4-a5b9-a3c2b19087e2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:45.536087 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d3450999-0018-44e4-a5b9-a3c2b19087e2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:45.545705 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3450999-0018-44e4-a5b9-a3c2b19087e2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:45.546317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3450999-0018-44e4-a5b9-a3c2b19087e2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:45.547154 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3450999-0018-44e4-a5b9-a3c2b19087e2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:45.548100 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3450999-0018-44e4-a5b9-a3c2b19087e2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:45.549153 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3450999-0018-44e4-a5b9-a3c2b19087e2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:45.549890 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d3450999-0018-44e4-a5b9-a3c2b19087e2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:45.557895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-59018e3e-7b90-426d-9f48-1252346d8f9d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:45.559967 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-59018e3e-7b90-426d-9f48-1252346d8f9d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:45.561215 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-59018e3e-7b90-426d-9f48-1252346d8f9d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:45.562075 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-59018e3e-7b90-426d-9f48-1252346d8f9d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:45.562551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-59018e3e-7b90-426d-9f48-1252346d8f9d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:45.562986 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-59018e3e-7b90-426d-9f48-1252346d8f9d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:45.683916 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-59018e3e-7b90-426d-9f48-1252346d8f9d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:45.691966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-59018e3e-7b90-426d-9f48-1252346d8f9d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1132 microversion: 2.1 time: 0.165389 Aug 05 20:46:45.692613 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 189/379] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:45 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1132 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:45.740679 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d3450999-0018-44e4-a5b9-a3c2b19087e2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:45.748526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d3450999-0018-44e4-a5b9-a3c2b19087e2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.221954 Aug 05 20:46:45.749087 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 191/380] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:45 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:46.108533 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-152de7ac-f151-4f24-880c-f5e1552f5d4c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:46.109328 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-152de7ac-f151-4f24-880c-f5e1552f5d4c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:46.117969 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-152de7ac-f151-4f24-880c-f5e1552f5d4c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:46.118587 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-152de7ac-f151-4f24-880c-f5e1552f5d4c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:46.119182 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-152de7ac-f151-4f24-880c-f5e1552f5d4c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:46.120125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-152de7ac-f151-4f24-880c-f5e1552f5d4c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:46.120724 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-152de7ac-f151-4f24-880c-f5e1552f5d4c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:46.121279 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-152de7ac-f151-4f24-880c-f5e1552f5d4c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:46.261944 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-152de7ac-f151-4f24-880c-f5e1552f5d4c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:46.266904 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:46.272710 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-152de7ac-f151-4f24-880c-f5e1552f5d4c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.169119 Aug 05 20:46:46.273481 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 190/381] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:46 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:46.421406 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-653414a1-2f73-47d8-9c5a-2885ec984f49 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:46.422418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-653414a1-2f73-47d8-9c5a-2885ec984f49 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:46.430040 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-653414a1-2f73-47d8-9c5a-2885ec984f49 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:46.430527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-653414a1-2f73-47d8-9c5a-2885ec984f49 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:46.431053 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-653414a1-2f73-47d8-9c5a-2885ec984f49 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:46.431720 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-653414a1-2f73-47d8-9c5a-2885ec984f49 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:46.432218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-653414a1-2f73-47d8-9c5a-2885ec984f49 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:46.432606 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-653414a1-2f73-47d8-9c5a-2885ec984f49 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:46.572541 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-653414a1-2f73-47d8-9c5a-2885ec984f49 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:46.581640 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-653414a1-2f73-47d8-9c5a-2885ec984f49 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:46.583303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-653414a1-2f73-47d8-9c5a-2885ec984f49 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:46.584425 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-653414a1-2f73-47d8-9c5a-2885ec984f49 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1755 microversion: 2.20 time: 0.169589 Aug 05 20:46:46.587420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 192/382] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:46 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:46.713520 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-df1b9918-354c-4314-93a6-e6fc8d0e9d24 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:46.714175 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-df1b9918-354c-4314-93a6-e6fc8d0e9d24 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:46.722817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-df1b9918-354c-4314-93a6-e6fc8d0e9d24 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:46.723608 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-df1b9918-354c-4314-93a6-e6fc8d0e9d24 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:46.724197 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-df1b9918-354c-4314-93a6-e6fc8d0e9d24 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:46.725083 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-df1b9918-354c-4314-93a6-e6fc8d0e9d24 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:46.725532 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-df1b9918-354c-4314-93a6-e6fc8d0e9d24 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:46.725958 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-df1b9918-354c-4314-93a6-e6fc8d0e9d24 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:46.769976 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0a04d681-f182-44f2-978e-a52a99556e5e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:46.770600 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0a04d681-f182-44f2-978e-a52a99556e5e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:46.796224 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a04d681-f182-44f2-978e-a52a99556e5e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:46.796963 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a04d681-f182-44f2-978e-a52a99556e5e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:46.797425 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a04d681-f182-44f2-978e-a52a99556e5e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:46.798176 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a04d681-f182-44f2-978e-a52a99556e5e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:46.798642 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a04d681-f182-44f2-978e-a52a99556e5e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:46.806309 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a04d681-f182-44f2-978e-a52a99556e5e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:46.844077 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-df1b9918-354c-4314-93a6-e6fc8d0e9d24 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:46.857693 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-df1b9918-354c-4314-93a6-e6fc8d0e9d24 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1188 microversion: 2.1 time: 0.147143 Aug 05 20:46:46.859835 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 191/383] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:46 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1188 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:47.090420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0a04d681-f182-44f2-978e-a52a99556e5e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:47.099015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0a04d681-f182-44f2-978e-a52a99556e5e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.333558 Aug 05 20:46:47.099612 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 193/384] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:46 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:47.300208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-5945a10b-0e86-414f-9bc3-d3a4456a51e7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:47.302326 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-5945a10b-0e86-414f-9bc3-d3a4456a51e7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:47.319497 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5945a10b-0e86-414f-9bc3-d3a4456a51e7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:47.321927 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5945a10b-0e86-414f-9bc3-d3a4456a51e7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:47.323491 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5945a10b-0e86-414f-9bc3-d3a4456a51e7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:47.325777 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5945a10b-0e86-414f-9bc3-d3a4456a51e7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:47.327778 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5945a10b-0e86-414f-9bc3-d3a4456a51e7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:47.329478 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5945a10b-0e86-414f-9bc3-d3a4456a51e7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:47.567488 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-50be80bf-5be7-4e1a-82fc-7a22871f2cf2 req-50aec174-a46f-4641-9586-8f75287eafb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a270d6db-218c-4081-81b9-b161dc70a7bb", "name": "network-vif-plugged", "status": "completed", "tag": "ff5e6ab7-ec2b-46dd-b050-f4b9bceff071"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:47.581783 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-50be80bf-5be7-4e1a-82fc-7a22871f2cf2 req-50aec174-a46f-4641-9586-8f75287eafb7 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:47.583609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-50be80bf-5be7-4e1a-82fc-7a22871f2cf2 req-50aec174-a46f-4641-9586-8f75287eafb7 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:47.584272 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-50be80bf-5be7-4e1a-82fc-7a22871f2cf2 req-50aec174-a46f-4641-9586-8f75287eafb7 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:47.602484 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-50be80bf-5be7-4e1a-82fc-7a22871f2cf2 req-50aec174-a46f-4641-9586-8f75287eafb7 service nova] Creating event network-vif-plugged:ff5e6ab7-ec2b-46dd-b050-f4b9bceff071 for instance a270d6db-218c-4081-81b9-b161dc70a7bb on hv-cinder-85220 Aug 05 20:46:47.611720 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-50be80bf-5be7-4e1a-82fc-7a22871f2cf2 req-50aec174-a46f-4641-9586-8f75287eafb7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047850 Aug 05 20:46:47.613877 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 194/385] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:46:47.620773 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f8ccd190-894b-408e-85a4-564b5fe739d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:47.621671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f8ccd190-894b-408e-85a4-564b5fe739d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:47.630600 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8ccd190-894b-408e-85a4-564b5fe739d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:47.631401 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8ccd190-894b-408e-85a4-564b5fe739d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:47.632012 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8ccd190-894b-408e-85a4-564b5fe739d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:47.632900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8ccd190-894b-408e-85a4-564b5fe739d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:47.634042 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8ccd190-894b-408e-85a4-564b5fe739d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:47.634633 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8ccd190-894b-408e-85a4-564b5fe739d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:47.664067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:47.665636 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-5945a10b-0e86-414f-9bc3-d3a4456a51e7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:47.680046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-5945a10b-0e86-414f-9bc3-d3a4456a51e7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.388616 Aug 05 20:46:47.714863 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 192/386] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:47 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:47.882007 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e2d9d71b-afe7-460c-8907-56132ddc7827 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:47.883025 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e2d9d71b-afe7-460c-8907-56132ddc7827 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:47.895990 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e2d9d71b-afe7-460c-8907-56132ddc7827 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:47.906990 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e2d9d71b-afe7-460c-8907-56132ddc7827 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:47.909490 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e2d9d71b-afe7-460c-8907-56132ddc7827 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:47.910606 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e2d9d71b-afe7-460c-8907-56132ddc7827 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:47.911954 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e2d9d71b-afe7-460c-8907-56132ddc7827 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:47.913995 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e2d9d71b-afe7-460c-8907-56132ddc7827 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:48.001855 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f8ccd190-894b-408e-85a4-564b5fe739d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:48.011727 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f8ccd190-894b-408e-85a4-564b5fe739d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:48.013571 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f8ccd190-894b-408e-85a4-564b5fe739d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:48.014996 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f8ccd190-894b-408e-85a4-564b5fe739d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1755 microversion: 2.20 time: 0.399701 Aug 05 20:46:48.015792 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 195/387] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:47 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1755 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:48.024420 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-e2d9d71b-afe7-460c-8907-56132ddc7827 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:48.034343 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e2d9d71b-afe7-460c-8907-56132ddc7827 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1206 microversion: 2.1 time: 0.157985 Aug 05 20:46:48.034927 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 193/388] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:47 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1206 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:48.122405 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e9c6764c-adc4-4a8f-9e72-0ddbc0305258 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:48.123325 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e9c6764c-adc4-4a8f-9e72-0ddbc0305258 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:48.129552 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9c6764c-adc4-4a8f-9e72-0ddbc0305258 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:48.130428 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9c6764c-adc4-4a8f-9e72-0ddbc0305258 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:48.130864 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9c6764c-adc4-4a8f-9e72-0ddbc0305258 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:48.131609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9c6764c-adc4-4a8f-9e72-0ddbc0305258 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:48.132078 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9c6764c-adc4-4a8f-9e72-0ddbc0305258 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:48.132500 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e9c6764c-adc4-4a8f-9e72-0ddbc0305258 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:48.318440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e9c6764c-adc4-4a8f-9e72-0ddbc0305258 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:48.327150 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e9c6764c-adc4-4a8f-9e72-0ddbc0305258 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.209429 Aug 05 20:46:48.330978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 196/389] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:48 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:48.738514 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0b8a1b1f-6cf4-4880-b96f-7bcf15648daf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:48.739263 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0b8a1b1f-6cf4-4880-b96f-7bcf15648daf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:48.774822 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b8a1b1f-6cf4-4880-b96f-7bcf15648daf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:48.775682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b8a1b1f-6cf4-4880-b96f-7bcf15648daf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:48.777606 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b8a1b1f-6cf4-4880-b96f-7bcf15648daf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:48.779171 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b8a1b1f-6cf4-4880-b96f-7bcf15648daf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:48.781362 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b8a1b1f-6cf4-4880-b96f-7bcf15648daf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:48.782002 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b8a1b1f-6cf4-4880-b96f-7bcf15648daf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:49.041365 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3ff01115-2a3d-47b1-bbf5-b4535e7ddbda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:49.042771 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3ff01115-2a3d-47b1-bbf5-b4535e7ddbda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:49.054209 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3ff01115-2a3d-47b1-bbf5-b4535e7ddbda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:49.055276 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3ff01115-2a3d-47b1-bbf5-b4535e7ddbda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:49.056319 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3ff01115-2a3d-47b1-bbf5-b4535e7ddbda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:49.057567 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3ff01115-2a3d-47b1-bbf5-b4535e7ddbda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:49.058466 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3ff01115-2a3d-47b1-bbf5-b4535e7ddbda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:49.059208 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3ff01115-2a3d-47b1-bbf5-b4535e7ddbda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:49.500358 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3ff01115-2a3d-47b1-bbf5-b4535e7ddbda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:49.503391 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0b8a1b1f-6cf4-4880-b96f-7bcf15648daf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:49.531907 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0b8a1b1f-6cf4-4880-b96f-7bcf15648daf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1527 microversion: 2.1 time: 0.799976 Aug 05 20:46:49.536994 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3ff01115-2a3d-47b1-bbf5-b4535e7ddbda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:49.537423 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 194/390] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:48 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1527 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:49.546526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3ff01115-2a3d-47b1-bbf5-b4535e7ddbda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:49.550430 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d3f64912-d9b0-4be9-984e-6043638102af tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:49.551478 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d3f64912-d9b0-4be9-984e-6043638102af tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:49.555049 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3ff01115-2a3d-47b1-bbf5-b4535e7ddbda tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.511042 Aug 05 20:46:49.556154 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 197/391] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:49 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:49.562820 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d3f64912-d9b0-4be9-984e-6043638102af tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:49.563448 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d3f64912-d9b0-4be9-984e-6043638102af tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:49.563895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d3f64912-d9b0-4be9-984e-6043638102af tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:49.564629 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d3f64912-d9b0-4be9-984e-6043638102af tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:49.565084 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d3f64912-d9b0-4be9-984e-6043638102af tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:49.565482 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d3f64912-d9b0-4be9-984e-6043638102af tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:49.571328 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e8854e13-b59e-48ff-a834-11e47320785c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:49.571984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e8854e13-b59e-48ff-a834-11e47320785c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:49.580605 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e8854e13-b59e-48ff-a834-11e47320785c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:49.581110 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e8854e13-b59e-48ff-a834-11e47320785c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:49.583332 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e8854e13-b59e-48ff-a834-11e47320785c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:49.584509 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e8854e13-b59e-48ff-a834-11e47320785c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:49.584969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e8854e13-b59e-48ff-a834-11e47320785c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:49.601543 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e8854e13-b59e-48ff-a834-11e47320785c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:50.007842 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e8854e13-b59e-48ff-a834-11e47320785c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:50.012329 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d3f64912-d9b0-4be9-984e-6043638102af tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:50.015556 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e8854e13-b59e-48ff-a834-11e47320785c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1362 microversion: 2.1 time: 0.458338 Aug 05 20:46:50.016346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 198/392] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:49 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:50.032080 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d3f64912-d9b0-4be9-984e-6043638102af tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1273 microversion: 2.1 time: 0.490569 Aug 05 20:46:50.032779 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 195/393] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:49 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1273 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:50.556579 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6e47e09f-d1d1-4009-9483-254fbdc7bca3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:50.557170 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6e47e09f-d1d1-4009-9483-254fbdc7bca3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:50.566491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e47e09f-d1d1-4009-9483-254fbdc7bca3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:50.567068 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e47e09f-d1d1-4009-9483-254fbdc7bca3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:50.567541 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e47e09f-d1d1-4009-9483-254fbdc7bca3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:50.568255 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e47e09f-d1d1-4009-9483-254fbdc7bca3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:50.568705 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e47e09f-d1d1-4009-9483-254fbdc7bca3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:50.569120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e47e09f-d1d1-4009-9483-254fbdc7bca3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:50.582824 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8fe50857-1ab2-4a35-86de-efbe4fe0c87c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:50.583784 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8fe50857-1ab2-4a35-86de-efbe4fe0c87c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:50.594405 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8fe50857-1ab2-4a35-86de-efbe4fe0c87c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:50.594892 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8fe50857-1ab2-4a35-86de-efbe4fe0c87c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:50.595323 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8fe50857-1ab2-4a35-86de-efbe4fe0c87c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:50.596052 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8fe50857-1ab2-4a35-86de-efbe4fe0c87c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:50.596500 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8fe50857-1ab2-4a35-86de-efbe4fe0c87c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:50.596915 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8fe50857-1ab2-4a35-86de-efbe4fe0c87c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:50.930849 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8fe50857-1ab2-4a35-86de-efbe4fe0c87c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:50.963168 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8fe50857-1ab2-4a35-86de-efbe4fe0c87c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:50.968546 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8fe50857-1ab2-4a35-86de-efbe4fe0c87c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:50.972739 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8fe50857-1ab2-4a35-86de-efbe4fe0c87c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.393698 Aug 05 20:46:50.976201 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 196/394] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:50 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:51.001199 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6e47e09f-d1d1-4009-9483-254fbdc7bca3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:51.011742 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6e47e09f-d1d1-4009-9483-254fbdc7bca3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1507 microversion: 2.1 time: 0.459023 Aug 05 20:46:51.013127 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 199/395] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:50 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:51.036695 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7026ba9e-f576-4f14-94df-3fcfd8243078 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:51.037397 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-5abb41c4-e0de-428a-9dfa-9e2e24679605 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:51.037907 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7026ba9e-f576-4f14-94df-3fcfd8243078 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:51.038701 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-5abb41c4-e0de-428a-9dfa-9e2e24679605 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:51.047350 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7026ba9e-f576-4f14-94df-3fcfd8243078 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:51.047649 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5abb41c4-e0de-428a-9dfa-9e2e24679605 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:51.048327 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5abb41c4-e0de-428a-9dfa-9e2e24679605 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:51.048484 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7026ba9e-f576-4f14-94df-3fcfd8243078 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:51.048967 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7026ba9e-f576-4f14-94df-3fcfd8243078 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:51.049692 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5abb41c4-e0de-428a-9dfa-9e2e24679605 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:51.049874 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7026ba9e-f576-4f14-94df-3fcfd8243078 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:51.050754 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7026ba9e-f576-4f14-94df-3fcfd8243078 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:51.051759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5abb41c4-e0de-428a-9dfa-9e2e24679605 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:51.054550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5abb41c4-e0de-428a-9dfa-9e2e24679605 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:51.055291 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5abb41c4-e0de-428a-9dfa-9e2e24679605 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:51.056992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7026ba9e-f576-4f14-94df-3fcfd8243078 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:51.532806 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7026ba9e-f576-4f14-94df-3fcfd8243078 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:51.544550 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7026ba9e-f576-4f14-94df-3fcfd8243078 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1551 microversion: 2.1 time: 0.511593 Aug 05 20:46:51.555752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 200/396] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:51 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1551 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:51.555752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-033e13ed-90c2-4163-a383-0dbf83305676 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:51.555752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-033e13ed-90c2-4163-a383-0dbf83305676 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:51.566969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-033e13ed-90c2-4163-a383-0dbf83305676 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:51.567654 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-5abb41c4-e0de-428a-9dfa-9e2e24679605 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:51.567770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-033e13ed-90c2-4163-a383-0dbf83305676 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:51.568376 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-033e13ed-90c2-4163-a383-0dbf83305676 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:51.569304 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-033e13ed-90c2-4163-a383-0dbf83305676 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:51.569914 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-033e13ed-90c2-4163-a383-0dbf83305676 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:51.570449 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-033e13ed-90c2-4163-a383-0dbf83305676 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:51.575637 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-5abb41c4-e0de-428a-9dfa-9e2e24679605 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1520 microversion: 2.1 time: 0.546269 Aug 05 20:46:51.583858 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 197/397] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:51 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1520 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:51.589017 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-73dbf509-86b8-424a-9e34-bb21dc3137fd req-6f315db5-a3b1-44f9-8f2f-de074623f384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12ad125-6f29-4ee3-971f-d1c23391c89f", "tag": "aca05bcd-9297-4365-a6e9-dca538228f87"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:51.603835 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-73dbf509-86b8-424a-9e34-bb21dc3137fd req-6f315db5-a3b1-44f9-8f2f-de074623f384 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:51.604373 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-73dbf509-86b8-424a-9e34-bb21dc3137fd req-6f315db5-a3b1-44f9-8f2f-de074623f384 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:51.607924 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-73dbf509-86b8-424a-9e34-bb21dc3137fd req-6f315db5-a3b1-44f9-8f2f-de074623f384 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:51.632499 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-73dbf509-86b8-424a-9e34-bb21dc3137fd req-6f315db5-a3b1-44f9-8f2f-de074623f384 service nova] Creating event network-changed:aca05bcd-9297-4365-a6e9-dca538228f87 for instance c12ad125-6f29-4ee3-971f-d1c23391c89f on hv-cinder-85220 Aug 05 20:46:51.638387 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-73dbf509-86b8-424a-9e34-bb21dc3137fd req-6f315db5-a3b1-44f9-8f2f-de074623f384 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052741 Aug 05 20:46:51.639180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 198/398] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:46:51.644800 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-dc248c28-4bbf-47f8-b59f-2c1bd8349906 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:51.645771 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-dc248c28-4bbf-47f8-b59f-2c1bd8349906 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:51.653852 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dc248c28-4bbf-47f8-b59f-2c1bd8349906 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:51.654507 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dc248c28-4bbf-47f8-b59f-2c1bd8349906 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:51.659411 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dc248c28-4bbf-47f8-b59f-2c1bd8349906 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:51.659411 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dc248c28-4bbf-47f8-b59f-2c1bd8349906 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:51.659411 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dc248c28-4bbf-47f8-b59f-2c1bd8349906 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:51.659411 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dc248c28-4bbf-47f8-b59f-2c1bd8349906 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:52.079398 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-033e13ed-90c2-4163-a383-0dbf83305676 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:52.088000 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-033e13ed-90c2-4163-a383-0dbf83305676 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.541501 Aug 05 20:46:52.088587 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 201/399] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:51 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:52.100090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e05df7ed-a9a3-4fc7-91b3-0694d9fe4edf tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:52.100613 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e05df7ed-a9a3-4fc7-91b3-0694d9fe4edf tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:52.116319 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e05df7ed-a9a3-4fc7-91b3-0694d9fe4edf tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:52.116836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e05df7ed-a9a3-4fc7-91b3-0694d9fe4edf tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:52.117279 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e05df7ed-a9a3-4fc7-91b3-0694d9fe4edf tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:52.118086 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e05df7ed-a9a3-4fc7-91b3-0694d9fe4edf tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:52.118767 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e05df7ed-a9a3-4fc7-91b3-0694d9fe4edf tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:52.119350 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e05df7ed-a9a3-4fc7-91b3-0694d9fe4edf tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:52.144615 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-dc248c28-4bbf-47f8-b59f-2c1bd8349906 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:52.165662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-dc248c28-4bbf-47f8-b59f-2c1bd8349906 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1551 microversion: 2.1 time: 0.525427 Aug 05 20:46:52.166246 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 199/400] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:51 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1551 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:52.195473 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-305815cc-3338-4a09-b776-f6bacdaa9568 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:52.201606 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-305815cc-3338-4a09-b776-f6bacdaa9568 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:52.202450 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-305815cc-3338-4a09-b776-f6bacdaa9568 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Searching by: {'deleted': False, 'project_id': '958a479cb6904c1bb6e6868c2b061e02'} {{(pid=124431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 05 20:46:52.211897 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-305815cc-3338-4a09-b776-f6bacdaa9568 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:52.212699 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-305815cc-3338-4a09-b776-f6bacdaa9568 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:52.213340 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-305815cc-3338-4a09-b776-f6bacdaa9568 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:52.214729 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-305815cc-3338-4a09-b776-f6bacdaa9568 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:52.215743 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-305815cc-3338-4a09-b776-f6bacdaa9568 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:52.216429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-305815cc-3338-4a09-b776-f6bacdaa9568 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:52.333688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.multi_cell_list [None req-305815cc-3338-4a09-b776-f6bacdaa9568 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 05 20:46:52.413173 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e05df7ed-a9a3-4fc7-91b3-0694d9fe4edf tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:52.430137 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e05df7ed-a9a3-4fc7-91b3-0694d9fe4edf tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:52.433198 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e05df7ed-a9a3-4fc7-91b3-0694d9fe4edf tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:52.436741 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e05df7ed-a9a3-4fc7-91b3-0694d9fe4edf tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.344940 Aug 05 20:46:52.438516 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 202/401] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:52 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:52.483410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-305815cc-3338-4a09-b776-f6bacdaa9568 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.292262 Aug 05 20:46:52.490643 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 200/402] 10.222.0.100 () {58 vars in 1130 bytes} [Fri Aug 5 20:46:52 2022] GET /compute/v2.1/servers => generated 344 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:46:52.495650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ebc7aebb-d65c-4d81-ae10-5394a7df330c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:52.496272 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ebc7aebb-d65c-4d81-ae10-5394a7df330c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:52.502661 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebc7aebb-d65c-4d81-ae10-5394a7df330c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:52.503174 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebc7aebb-d65c-4d81-ae10-5394a7df330c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:52.503898 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebc7aebb-d65c-4d81-ae10-5394a7df330c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:52.504842 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebc7aebb-d65c-4d81-ae10-5394a7df330c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:52.505329 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebc7aebb-d65c-4d81-ae10-5394a7df330c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:52.505992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebc7aebb-d65c-4d81-ae10-5394a7df330c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:52.675859 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ebc7aebb-d65c-4d81-ae10-5394a7df330c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:52.685480 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ebc7aebb-d65c-4d81-ae10-5394a7df330c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1551 microversion: 2.1 time: 0.193591 Aug 05 20:46:52.686330 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 203/403] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:52 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1551 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:53.100670 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-83c1042b-2b45-4d70-b149-4f2db6755888 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:53.113797 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-83c1042b-2b45-4d70-b149-4f2db6755888 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:53.124208 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-26652956-77ed-4de8-8152-02529b38124b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:53.127181 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-26652956-77ed-4de8-8152-02529b38124b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:53.130117 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:53.130967 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:53.138815 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83c1042b-2b45-4d70-b149-4f2db6755888 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:53.139561 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83c1042b-2b45-4d70-b149-4f2db6755888 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:53.151798 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83c1042b-2b45-4d70-b149-4f2db6755888 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:53.152622 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83c1042b-2b45-4d70-b149-4f2db6755888 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:53.153290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83c1042b-2b45-4d70-b149-4f2db6755888 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:53.153892 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-83c1042b-2b45-4d70-b149-4f2db6755888 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:53.166054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26652956-77ed-4de8-8152-02529b38124b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:53.167687 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26652956-77ed-4de8-8152-02529b38124b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:53.168199 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26652956-77ed-4de8-8152-02529b38124b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:53.169113 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26652956-77ed-4de8-8152-02529b38124b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:53.169787 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26652956-77ed-4de8-8152-02529b38124b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:53.170371 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26652956-77ed-4de8-8152-02529b38124b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:53.233544 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-83c1042b-2b45-4d70-b149-4f2db6755888 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lazy-loading 'flavor' on Instance uuid 601febf0-78f3-4519-b08f-382dad6f8839 {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:46:53.387480 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:53.437502 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-83c1042b-2b45-4d70-b149-4f2db6755888 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "POST /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839/action" status: 200 len: 32 microversion: 2.1 time: 0.340818 Aug 05 20:46:53.438896 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 201/404] 10.222.0.100 () {60 vars in 1283 bytes} [Fri Aug 5 20:46:53 2022] POST /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839/action => generated 32 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:46:53.456398 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-15046604-3559-4caa-81de-e9d0196d213b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:53.457394 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-15046604-3559-4caa-81de-e9d0196d213b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:53.466918 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15046604-3559-4caa-81de-e9d0196d213b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:53.468681 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15046604-3559-4caa-81de-e9d0196d213b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:53.469291 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15046604-3559-4caa-81de-e9d0196d213b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:53.470219 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15046604-3559-4caa-81de-e9d0196d213b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:53.470830 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15046604-3559-4caa-81de-e9d0196d213b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:53.471639 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15046604-3559-4caa-81de-e9d0196d213b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:53.902054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-26652956-77ed-4de8-8152-02529b38124b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:53.911667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-26652956-77ed-4de8-8152-02529b38124b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.792534 Aug 05 20:46:53.920613 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 204/405] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:53 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:53.926574 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0b61b8d7-452b-4407-9e10-ffe684832f6c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:53.927406 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0b61b8d7-452b-4407-9e10-ffe684832f6c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:53.931532 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:53.940994 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b61b8d7-452b-4407-9e10-ffe684832f6c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:53.941959 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b61b8d7-452b-4407-9e10-ffe684832f6c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:53.942144 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b61b8d7-452b-4407-9e10-ffe684832f6c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:53.942846 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b61b8d7-452b-4407-9e10-ffe684832f6c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:53.943289 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b61b8d7-452b-4407-9e10-ffe684832f6c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:53.943729 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b61b8d7-452b-4407-9e10-ffe684832f6c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:54.252885 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-15046604-3559-4caa-81de-e9d0196d213b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:54.262621 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-15046604-3559-4caa-81de-e9d0196d213b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.817543 Aug 05 20:46:54.267718 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 202/406] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:53 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:54.319296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0b61b8d7-452b-4407-9e10-ffe684832f6c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:54.329928 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0b61b8d7-452b-4407-9e10-ffe684832f6c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:54.331880 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0b61b8d7-452b-4407-9e10-ffe684832f6c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:54.333290 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0b61b8d7-452b-4407-9e10-ffe684832f6c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.410690 Aug 05 20:46:54.334338 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 205/407] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:53 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:54.636049 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-6da2166d-0dfd-4e81-b4a1-06dc0ed5bc05 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cd0caf0-9f6b-44ee-83cb-7afe693758fd"}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:46:54.642630 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-6da2166d-0dfd-4e81-b4a1-06dc0ed5bc05 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:54.653567 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6da2166d-0dfd-4e81-b4a1-06dc0ed5bc05 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:54.654463 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6da2166d-0dfd-4e81-b4a1-06dc0ed5bc05 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:54.656065 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6da2166d-0dfd-4e81-b4a1-06dc0ed5bc05 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:54.657216 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6da2166d-0dfd-4e81-b4a1-06dc0ed5bc05 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:54.661307 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6da2166d-0dfd-4e81-b4a1-06dc0ed5bc05 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:54.662281 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6da2166d-0dfd-4e81-b4a1-06dc0ed5bc05 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:54.943143 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-73486d03-eacb-478e-89b7-5dbab96a77c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:54.943850 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-73486d03-eacb-478e-89b7-5dbab96a77c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:54.951539 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73486d03-eacb-478e-89b7-5dbab96a77c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:54.952188 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73486d03-eacb-478e-89b7-5dbab96a77c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:54.952725 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73486d03-eacb-478e-89b7-5dbab96a77c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:54.953682 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73486d03-eacb-478e-89b7-5dbab96a77c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:54.954237 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73486d03-eacb-478e-89b7-5dbab96a77c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:54.954766 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73486d03-eacb-478e-89b7-5dbab96a77c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:55.282011 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-73486d03-eacb-478e-89b7-5dbab96a77c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:55.294984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-73486d03-eacb-478e-89b7-5dbab96a77c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.356613 Aug 05 20:46:55.299690 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 206/408] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:54 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:55.313318 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-43559a24-892c-45c4-b358-90083654b14e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:55.313998 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-43559a24-892c-45c4-b358-90083654b14e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:55.332852 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43559a24-892c-45c4-b358-90083654b14e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:55.333352 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43559a24-892c-45c4-b358-90083654b14e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:55.333796 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43559a24-892c-45c4-b358-90083654b14e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:55.334575 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43559a24-892c-45c4-b358-90083654b14e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:55.335039 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43559a24-892c-45c4-b358-90083654b14e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:55.335414 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43559a24-892c-45c4-b358-90083654b14e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:55.516772 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-43559a24-892c-45c4-b358-90083654b14e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:55.527131 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-43559a24-892c-45c4-b358-90083654b14e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.226137 Aug 05 20:46:55.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 207/409] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:55 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:55.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-09462f07-8670-48c3-a522-8090fba7c84d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:55.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-09462f07-8670-48c3-a522-8090fba7c84d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:55.546680 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-09462f07-8670-48c3-a522-8090fba7c84d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:55.546680 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-09462f07-8670-48c3-a522-8090fba7c84d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:55.546680 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-09462f07-8670-48c3-a522-8090fba7c84d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:55.546680 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-09462f07-8670-48c3-a522-8090fba7c84d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:55.547136 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-09462f07-8670-48c3-a522-8090fba7c84d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:55.547136 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-09462f07-8670-48c3-a522-8090fba7c84d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:55.768091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-09462f07-8670-48c3-a522-8090fba7c84d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:55.777286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-09462f07-8670-48c3-a522-8090fba7c84d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:55.778818 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-09462f07-8670-48c3-a522-8090fba7c84d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:55.780426 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-09462f07-8670-48c3-a522-8090fba7c84d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.250917 Aug 05 20:46:55.781163 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 208/410] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:55 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:56.320358 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5b93c028-3363-4108-8dd6-7b7d4421dd5b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:56.321923 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5b93c028-3363-4108-8dd6-7b7d4421dd5b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:56.333499 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b93c028-3363-4108-8dd6-7b7d4421dd5b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:56.334012 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b93c028-3363-4108-8dd6-7b7d4421dd5b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:56.340115 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b93c028-3363-4108-8dd6-7b7d4421dd5b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:56.341172 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b93c028-3363-4108-8dd6-7b7d4421dd5b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:56.341678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b93c028-3363-4108-8dd6-7b7d4421dd5b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:56.342105 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b93c028-3363-4108-8dd6-7b7d4421dd5b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:56.515842 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5b93c028-3363-4108-8dd6-7b7d4421dd5b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:56.524718 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5b93c028-3363-4108-8dd6-7b7d4421dd5b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.208776 Aug 05 20:46:56.525226 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 209/411] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:56 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:56.556813 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6d13d2fe-7004-4906-9e32-b5b0e67809eb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:56.558452 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6d13d2fe-7004-4906-9e32-b5b0e67809eb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:56.568997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d13d2fe-7004-4906-9e32-b5b0e67809eb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:56.572496 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d13d2fe-7004-4906-9e32-b5b0e67809eb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:56.572991 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d13d2fe-7004-4906-9e32-b5b0e67809eb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:56.573813 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d13d2fe-7004-4906-9e32-b5b0e67809eb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:56.574377 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d13d2fe-7004-4906-9e32-b5b0e67809eb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:56.574897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d13d2fe-7004-4906-9e32-b5b0e67809eb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:56.759913 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6d13d2fe-7004-4906-9e32-b5b0e67809eb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:56.769718 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6d13d2fe-7004-4906-9e32-b5b0e67809eb tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.219389 Aug 05 20:46:56.772669 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 210/412] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:56 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:56.805537 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-29207712-be4e-4f6b-ba91-fa999a218b90 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:56.806535 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-29207712-be4e-4f6b-ba91-fa999a218b90 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:56.816228 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29207712-be4e-4f6b-ba91-fa999a218b90 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:56.819130 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29207712-be4e-4f6b-ba91-fa999a218b90 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:56.824339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29207712-be4e-4f6b-ba91-fa999a218b90 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:56.825512 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29207712-be4e-4f6b-ba91-fa999a218b90 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:56.825994 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29207712-be4e-4f6b-ba91-fa999a218b90 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:56.826430 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-29207712-be4e-4f6b-ba91-fa999a218b90 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:56.992896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-29207712-be4e-4f6b-ba91-fa999a218b90 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:57.003487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-29207712-be4e-4f6b-ba91-fa999a218b90 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:57.005760 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-29207712-be4e-4f6b-ba91-fa999a218b90 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:57.007867 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-29207712-be4e-4f6b-ba91-fa999a218b90 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.207248 Aug 05 20:46:57.015405 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 211/413] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:56 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:57.548611 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a2b8952f-a95e-42f6-b187-a8e24a03b853 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:57.549368 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a2b8952f-a95e-42f6-b187-a8e24a03b853 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:57.560764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a2b8952f-a95e-42f6-b187-a8e24a03b853 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:57.561323 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a2b8952f-a95e-42f6-b187-a8e24a03b853 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:57.562008 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a2b8952f-a95e-42f6-b187-a8e24a03b853 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:57.563035 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a2b8952f-a95e-42f6-b187-a8e24a03b853 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:57.563643 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a2b8952f-a95e-42f6-b187-a8e24a03b853 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:57.564713 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a2b8952f-a95e-42f6-b187-a8e24a03b853 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:57.568022 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:46:57.731772 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a2b8952f-a95e-42f6-b187-a8e24a03b853 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:57.741965 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a2b8952f-a95e-42f6-b187-a8e24a03b853 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.198696 Aug 05 20:46:57.742673 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 212/414] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:57 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:57.798440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-81586e91-6754-4662-bcc3-41506d964539 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:57.799114 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-81586e91-6754-4662-bcc3-41506d964539 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:57.815497 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-81586e91-6754-4662-bcc3-41506d964539 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:57.816081 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-81586e91-6754-4662-bcc3-41506d964539 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:57.816669 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-81586e91-6754-4662-bcc3-41506d964539 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:57.817427 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-81586e91-6754-4662-bcc3-41506d964539 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:57.817904 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-81586e91-6754-4662-bcc3-41506d964539 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:57.819217 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-81586e91-6754-4662-bcc3-41506d964539 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:58.047655 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-81586e91-6754-4662-bcc3-41506d964539 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:58.057712 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-81586e91-6754-4662-bcc3-41506d964539 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.263803 Aug 05 20:46:58.058555 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 213/415] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:57 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:58.074074 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-640dca8d-dde0-4038-af97-28419b7a4a04 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:58.074692 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-640dca8d-dde0-4038-af97-28419b7a4a04 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:58.081502 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-640dca8d-dde0-4038-af97-28419b7a4a04 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:58.082028 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-640dca8d-dde0-4038-af97-28419b7a4a04 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:58.082484 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-640dca8d-dde0-4038-af97-28419b7a4a04 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:58.083270 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-640dca8d-dde0-4038-af97-28419b7a4a04 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:58.083764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-640dca8d-dde0-4038-af97-28419b7a4a04 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:58.084206 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-640dca8d-dde0-4038-af97-28419b7a4a04 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:58.232485 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-640dca8d-dde0-4038-af97-28419b7a4a04 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:58.242444 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-640dca8d-dde0-4038-af97-28419b7a4a04 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:58.244157 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-640dca8d-dde0-4038-af97-28419b7a4a04 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:58.245650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-640dca8d-dde0-4038-af97-28419b7a4a04 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.185715 Aug 05 20:46:58.255438 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 214/416] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:58 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:46:58.766149 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cafcf221-1690-4f82-b770-84994ff4f945 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:58.766960 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cafcf221-1690-4f82-b770-84994ff4f945 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:58.778813 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cafcf221-1690-4f82-b770-84994ff4f945 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:58.779310 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cafcf221-1690-4f82-b770-84994ff4f945 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:58.780360 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cafcf221-1690-4f82-b770-84994ff4f945 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:58.781082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cafcf221-1690-4f82-b770-84994ff4f945 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:58.781624 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cafcf221-1690-4f82-b770-84994ff4f945 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:58.781973 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cafcf221-1690-4f82-b770-84994ff4f945 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:58.986690 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cafcf221-1690-4f82-b770-84994ff4f945 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:59.000762 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cafcf221-1690-4f82-b770-84994ff4f945 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.239576 Aug 05 20:46:59.001556 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 215/417] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:58 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:46:59.084426 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-27f84b33-c021-4e45-a060-6e9c6fa0900e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:59.084426 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-27f84b33-c021-4e45-a060-6e9c6fa0900e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:59.100284 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-27f84b33-c021-4e45-a060-6e9c6fa0900e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:59.101189 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-27f84b33-c021-4e45-a060-6e9c6fa0900e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:59.101373 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-27f84b33-c021-4e45-a060-6e9c6fa0900e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:59.102120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-27f84b33-c021-4e45-a060-6e9c6fa0900e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:59.102606 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-27f84b33-c021-4e45-a060-6e9c6fa0900e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:59.103957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-27f84b33-c021-4e45-a060-6e9c6fa0900e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:59.355749 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-27f84b33-c021-4e45-a060-6e9c6fa0900e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:59.364119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-27f84b33-c021-4e45-a060-6e9c6fa0900e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.289753 Aug 05 20:46:59.365338 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 216/418] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:46:59 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:46:59.369525 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-85171b03-d514-43d2-897c-60b7fec1f3bc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:46:59.370118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-85171b03-d514-43d2-897c-60b7fec1f3bc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:46:59.376089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-85171b03-d514-43d2-897c-60b7fec1f3bc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:59.376575 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-85171b03-d514-43d2-897c-60b7fec1f3bc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:59.377007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-85171b03-d514-43d2-897c-60b7fec1f3bc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:59.377698 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-85171b03-d514-43d2-897c-60b7fec1f3bc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:46:59.378149 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-85171b03-d514-43d2-897c-60b7fec1f3bc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:46:59.378758 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-85171b03-d514-43d2-897c-60b7fec1f3bc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:46:59.648696 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-85171b03-d514-43d2-897c-60b7fec1f3bc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:59.661055 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-85171b03-d514-43d2-897c-60b7fec1f3bc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:59.663459 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-85171b03-d514-43d2-897c-60b7fec1f3bc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:46:59.664907 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-85171b03-d514-43d2-897c-60b7fec1f3bc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.298941 Aug 05 20:46:59.679382 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 217/419] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:46:59 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:00.024336 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8f28db27-2eb8-4b29-a039-326bc182ce05 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:00.025116 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8f28db27-2eb8-4b29-a039-326bc182ce05 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:00.033920 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f28db27-2eb8-4b29-a039-326bc182ce05 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:00.034481 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f28db27-2eb8-4b29-a039-326bc182ce05 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:00.035033 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f28db27-2eb8-4b29-a039-326bc182ce05 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:00.035844 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f28db27-2eb8-4b29-a039-326bc182ce05 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:00.036395 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f28db27-2eb8-4b29-a039-326bc182ce05 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:00.036878 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8f28db27-2eb8-4b29-a039-326bc182ce05 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:00.242870 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8f28db27-2eb8-4b29-a039-326bc182ce05 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:00.255087 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8f28db27-2eb8-4b29-a039-326bc182ce05 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.233023 Aug 05 20:47:00.268094 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 218/420] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:00 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:00.385652 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b1932b03-c78b-47c9-960a-c8e14ba169c9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:00.386803 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b1932b03-c78b-47c9-960a-c8e14ba169c9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:00.405126 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b1932b03-c78b-47c9-960a-c8e14ba169c9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:00.405625 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b1932b03-c78b-47c9-960a-c8e14ba169c9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:00.406065 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b1932b03-c78b-47c9-960a-c8e14ba169c9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:00.408650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b1932b03-c78b-47c9-960a-c8e14ba169c9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:00.409364 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b1932b03-c78b-47c9-960a-c8e14ba169c9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:00.412185 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b1932b03-c78b-47c9-960a-c8e14ba169c9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:00.618642 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b1932b03-c78b-47c9-960a-c8e14ba169c9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:00.629652 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b1932b03-c78b-47c9-960a-c8e14ba169c9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.247397 Aug 05 20:47:00.641816 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 219/421] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:00 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:00.692278 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-141a3895-49e0-4856-870f-ad201b9e2804 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:00.693923 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-141a3895-49e0-4856-870f-ad201b9e2804 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:00.713530 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-141a3895-49e0-4856-870f-ad201b9e2804 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:00.714371 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-141a3895-49e0-4856-870f-ad201b9e2804 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:00.715010 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-141a3895-49e0-4856-870f-ad201b9e2804 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:00.716034 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-141a3895-49e0-4856-870f-ad201b9e2804 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:00.716777 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-141a3895-49e0-4856-870f-ad201b9e2804 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:00.717476 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-141a3895-49e0-4856-870f-ad201b9e2804 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:00.912989 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-141a3895-49e0-4856-870f-ad201b9e2804 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:00.922415 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-141a3895-49e0-4856-870f-ad201b9e2804 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:00.924387 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-141a3895-49e0-4856-870f-ad201b9e2804 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:00.926096 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-141a3895-49e0-4856-870f-ad201b9e2804 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.237648 Aug 05 20:47:00.939385 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 220/422] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:00 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:47:01.276592 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9e21f50e-c9c0-487f-9feb-33c49ed26450 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:01.278125 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9e21f50e-c9c0-487f-9feb-33c49ed26450 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:01.286815 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e21f50e-c9c0-487f-9feb-33c49ed26450 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:01.287641 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e21f50e-c9c0-487f-9feb-33c49ed26450 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:01.288298 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e21f50e-c9c0-487f-9feb-33c49ed26450 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:01.289280 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e21f50e-c9c0-487f-9feb-33c49ed26450 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:01.290122 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e21f50e-c9c0-487f-9feb-33c49ed26450 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:01.290556 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e21f50e-c9c0-487f-9feb-33c49ed26450 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:01.465371 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9e21f50e-c9c0-487f-9feb-33c49ed26450 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:01.474584 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9e21f50e-c9c0-487f-9feb-33c49ed26450 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.202327 Aug 05 20:47:01.488869 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 221/423] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:01 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:01.653508 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9ca4ada1-1cb1-427c-bf9b-baa9e98a3db3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:01.654117 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9ca4ada1-1cb1-427c-bf9b-baa9e98a3db3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:01.666469 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9ca4ada1-1cb1-427c-bf9b-baa9e98a3db3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:01.667144 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9ca4ada1-1cb1-427c-bf9b-baa9e98a3db3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:01.667325 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9ca4ada1-1cb1-427c-bf9b-baa9e98a3db3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:01.668071 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9ca4ada1-1cb1-427c-bf9b-baa9e98a3db3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:01.668532 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9ca4ada1-1cb1-427c-bf9b-baa9e98a3db3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:01.669051 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9ca4ada1-1cb1-427c-bf9b-baa9e98a3db3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:01.875000 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9ca4ada1-1cb1-427c-bf9b-baa9e98a3db3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:01.884335 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9ca4ada1-1cb1-427c-bf9b-baa9e98a3db3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.234712 Aug 05 20:47:01.901585 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 222/424] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:01 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:01.987528 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e90455f6-4c8c-4199-b043-f017c3cb9979 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:01.988421 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e90455f6-4c8c-4199-b043-f017c3cb9979 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:01.995063 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e90455f6-4c8c-4199-b043-f017c3cb9979 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:01.995594 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e90455f6-4c8c-4199-b043-f017c3cb9979 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:01.996024 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e90455f6-4c8c-4199-b043-f017c3cb9979 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:01.998036 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e90455f6-4c8c-4199-b043-f017c3cb9979 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:01.999495 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e90455f6-4c8c-4199-b043-f017c3cb9979 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:02.000050 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e90455f6-4c8c-4199-b043-f017c3cb9979 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:02.225912 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e90455f6-4c8c-4199-b043-f017c3cb9979 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:02.236033 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e90455f6-4c8c-4199-b043-f017c3cb9979 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:02.237851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e90455f6-4c8c-4199-b043-f017c3cb9979 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:02.239331 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e90455f6-4c8c-4199-b043-f017c3cb9979 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.289941 Aug 05 20:47:02.239935 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 223/425] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:01 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:02.275144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:02.496257 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a1e00f4b-7471-44d9-979f-97f136402425 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:02.496882 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a1e00f4b-7471-44d9-979f-97f136402425 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:02.508816 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a1e00f4b-7471-44d9-979f-97f136402425 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:02.509314 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a1e00f4b-7471-44d9-979f-97f136402425 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:02.509751 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a1e00f4b-7471-44d9-979f-97f136402425 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:02.510458 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a1e00f4b-7471-44d9-979f-97f136402425 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:02.510917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a1e00f4b-7471-44d9-979f-97f136402425 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:02.511504 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a1e00f4b-7471-44d9-979f-97f136402425 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:02.693105 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a1e00f4b-7471-44d9-979f-97f136402425 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:02.702044 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a1e00f4b-7471-44d9-979f-97f136402425 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.210034 Aug 05 20:47:02.708330 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 224/426] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:02 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:02.907884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-868b21e7-a9ce-4500-ac0a-846b2f9d943e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:02.908524 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-868b21e7-a9ce-4500-ac0a-846b2f9d943e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:02.915905 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-868b21e7-a9ce-4500-ac0a-846b2f9d943e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:02.916487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-868b21e7-a9ce-4500-ac0a-846b2f9d943e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:02.917538 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-868b21e7-a9ce-4500-ac0a-846b2f9d943e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:02.918321 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-868b21e7-a9ce-4500-ac0a-846b2f9d943e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:02.918863 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-868b21e7-a9ce-4500-ac0a-846b2f9d943e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:02.919382 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-868b21e7-a9ce-4500-ac0a-846b2f9d943e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:03.088670 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-868b21e7-a9ce-4500-ac0a-846b2f9d943e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:03.096302 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-868b21e7-a9ce-4500-ac0a-846b2f9d943e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.192737 Aug 05 20:47:03.096898 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 225/427] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:02 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:03.263858 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-dd6157ab-e5d5-4524-bb17-0530d29dc675 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:03.264569 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-dd6157ab-e5d5-4524-bb17-0530d29dc675 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:03.271161 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd6157ab-e5d5-4524-bb17-0530d29dc675 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:03.271773 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd6157ab-e5d5-4524-bb17-0530d29dc675 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:03.272279 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd6157ab-e5d5-4524-bb17-0530d29dc675 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:03.273052 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd6157ab-e5d5-4524-bb17-0530d29dc675 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:03.273574 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd6157ab-e5d5-4524-bb17-0530d29dc675 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:03.274077 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd6157ab-e5d5-4524-bb17-0530d29dc675 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:03.416663 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-dd6157ab-e5d5-4524-bb17-0530d29dc675 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:03.425439 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-dd6157ab-e5d5-4524-bb17-0530d29dc675 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:03.427010 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-dd6157ab-e5d5-4524-bb17-0530d29dc675 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:03.428209 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-dd6157ab-e5d5-4524-bb17-0530d29dc675 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.168414 Aug 05 20:47:03.428858 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 226/428] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:03 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:47:03.722360 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-395bd82a-a430-41a3-ae74-514d662e7acb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:03.723428 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-395bd82a-a430-41a3-ae74-514d662e7acb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:03.730133 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-395bd82a-a430-41a3-ae74-514d662e7acb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:03.730627 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-395bd82a-a430-41a3-ae74-514d662e7acb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:03.731117 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-395bd82a-a430-41a3-ae74-514d662e7acb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:03.731896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-395bd82a-a430-41a3-ae74-514d662e7acb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:03.732345 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-395bd82a-a430-41a3-ae74-514d662e7acb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:03.732769 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-395bd82a-a430-41a3-ae74-514d662e7acb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:03.888264 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-395bd82a-a430-41a3-ae74-514d662e7acb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:03.896794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-395bd82a-a430-41a3-ae74-514d662e7acb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.178416 Aug 05 20:47:03.897654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 227/429] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:03 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:04.116928 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-48eadf7e-723e-45ab-9a1c-2cda301e14cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:04.117454 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-48eadf7e-723e-45ab-9a1c-2cda301e14cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:04.123699 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48eadf7e-723e-45ab-9a1c-2cda301e14cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:04.124194 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48eadf7e-723e-45ab-9a1c-2cda301e14cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:04.124627 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48eadf7e-723e-45ab-9a1c-2cda301e14cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:04.125325 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48eadf7e-723e-45ab-9a1c-2cda301e14cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:04.125781 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48eadf7e-723e-45ab-9a1c-2cda301e14cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:04.126207 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48eadf7e-723e-45ab-9a1c-2cda301e14cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:04.279320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-48eadf7e-723e-45ab-9a1c-2cda301e14cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:04.282111 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:04.289969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-48eadf7e-723e-45ab-9a1c-2cda301e14cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.177056 Aug 05 20:47:04.290693 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 228/430] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:04 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:04.451763 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e568d8e2-eb73-4ae9-a9a9-53027e50506c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:04.452377 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e568d8e2-eb73-4ae9-a9a9-53027e50506c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:04.460750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e568d8e2-eb73-4ae9-a9a9-53027e50506c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:04.461186 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e568d8e2-eb73-4ae9-a9a9-53027e50506c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:04.461802 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e568d8e2-eb73-4ae9-a9a9-53027e50506c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:04.462673 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e568d8e2-eb73-4ae9-a9a9-53027e50506c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:04.463265 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e568d8e2-eb73-4ae9-a9a9-53027e50506c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:04.463741 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e568d8e2-eb73-4ae9-a9a9-53027e50506c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:04.603160 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e568d8e2-eb73-4ae9-a9a9-53027e50506c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:04.611720 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e568d8e2-eb73-4ae9-a9a9-53027e50506c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:04.613374 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e568d8e2-eb73-4ae9-a9a9-53027e50506c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:04.614643 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e568d8e2-eb73-4ae9-a9a9-53027e50506c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.166954 Aug 05 20:47:04.615193 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 229/431] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:04 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:47:04.653758 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:04.765232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:04.920002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2837a16a-ab45-4e0b-a23b-708f3acc7ad8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:04.922583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2837a16a-ab45-4e0b-a23b-708f3acc7ad8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:04.932389 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2837a16a-ab45-4e0b-a23b-708f3acc7ad8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:04.934213 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2837a16a-ab45-4e0b-a23b-708f3acc7ad8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:04.935508 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2837a16a-ab45-4e0b-a23b-708f3acc7ad8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:04.936760 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2837a16a-ab45-4e0b-a23b-708f3acc7ad8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:04.937672 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2837a16a-ab45-4e0b-a23b-708f3acc7ad8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:04.938578 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2837a16a-ab45-4e0b-a23b-708f3acc7ad8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:05.109463 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2837a16a-ab45-4e0b-a23b-708f3acc7ad8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:05.117498 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2837a16a-ab45-4e0b-a23b-708f3acc7ad8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.203084 Aug 05 20:47:05.118081 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 230/432] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:04 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:05.312752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b4056294-4a2d-4db8-8de9-8d0fc295b977 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:05.313637 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b4056294-4a2d-4db8-8de9-8d0fc295b977 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:05.322063 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b4056294-4a2d-4db8-8de9-8d0fc295b977 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:05.322555 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b4056294-4a2d-4db8-8de9-8d0fc295b977 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:05.322992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b4056294-4a2d-4db8-8de9-8d0fc295b977 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:05.323730 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b4056294-4a2d-4db8-8de9-8d0fc295b977 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:05.324177 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b4056294-4a2d-4db8-8de9-8d0fc295b977 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:05.324597 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b4056294-4a2d-4db8-8de9-8d0fc295b977 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:05.460423 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b4056294-4a2d-4db8-8de9-8d0fc295b977 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:05.468044 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b4056294-4a2d-4db8-8de9-8d0fc295b977 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.159268 Aug 05 20:47:05.468638 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 231/433] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:05 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:05.638108 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-efd0f8f3-04d2-4aba-82bd-c7596efec499 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:05.638714 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-efd0f8f3-04d2-4aba-82bd-c7596efec499 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:05.645504 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-efd0f8f3-04d2-4aba-82bd-c7596efec499 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:05.645978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-efd0f8f3-04d2-4aba-82bd-c7596efec499 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:05.646419 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-efd0f8f3-04d2-4aba-82bd-c7596efec499 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:05.647093 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-efd0f8f3-04d2-4aba-82bd-c7596efec499 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:05.647570 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-efd0f8f3-04d2-4aba-82bd-c7596efec499 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:05.647987 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-efd0f8f3-04d2-4aba-82bd-c7596efec499 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:05.784140 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-efd0f8f3-04d2-4aba-82bd-c7596efec499 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:05.794374 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-efd0f8f3-04d2-4aba-82bd-c7596efec499 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:05.795923 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-efd0f8f3-04d2-4aba-82bd-c7596efec499 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:05.797105 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-efd0f8f3-04d2-4aba-82bd-c7596efec499 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.163014 Aug 05 20:47:05.797678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 232/434] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:05 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:06.142230 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7caa8ac0-8511-41c4-8dc3-09df87f14529 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:06.143553 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7caa8ac0-8511-41c4-8dc3-09df87f14529 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:06.149910 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7caa8ac0-8511-41c4-8dc3-09df87f14529 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:06.150382 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7caa8ac0-8511-41c4-8dc3-09df87f14529 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:06.150819 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7caa8ac0-8511-41c4-8dc3-09df87f14529 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:06.151531 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7caa8ac0-8511-41c4-8dc3-09df87f14529 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:06.152138 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7caa8ac0-8511-41c4-8dc3-09df87f14529 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:06.152703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7caa8ac0-8511-41c4-8dc3-09df87f14529 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:06.349370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7caa8ac0-8511-41c4-8dc3-09df87f14529 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:06.357794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7caa8ac0-8511-41c4-8dc3-09df87f14529 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.219040 Aug 05 20:47:06.358449 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 233/435] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:06 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:06.489855 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8ff841db-f04f-4456-9c22-0fbf322df601 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:06.490456 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8ff841db-f04f-4456-9c22-0fbf322df601 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:06.497258 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ff841db-f04f-4456-9c22-0fbf322df601 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:06.497738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ff841db-f04f-4456-9c22-0fbf322df601 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:06.498176 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ff841db-f04f-4456-9c22-0fbf322df601 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:06.498883 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ff841db-f04f-4456-9c22-0fbf322df601 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:06.499338 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ff841db-f04f-4456-9c22-0fbf322df601 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:06.499796 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ff841db-f04f-4456-9c22-0fbf322df601 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:06.643180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8ff841db-f04f-4456-9c22-0fbf322df601 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:06.651440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8ff841db-f04f-4456-9c22-0fbf322df601 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.165773 Aug 05 20:47:06.652302 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 234/436] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:06 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:06.820484 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-15322c88-208e-4d13-8a93-dbb4f63a962f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:06.821214 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-15322c88-208e-4d13-8a93-dbb4f63a962f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:06.827791 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15322c88-208e-4d13-8a93-dbb4f63a962f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:06.828256 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15322c88-208e-4d13-8a93-dbb4f63a962f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:06.828695 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15322c88-208e-4d13-8a93-dbb4f63a962f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:06.829424 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15322c88-208e-4d13-8a93-dbb4f63a962f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:06.829875 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15322c88-208e-4d13-8a93-dbb4f63a962f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:06.830302 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15322c88-208e-4d13-8a93-dbb4f63a962f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:06.968339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-15322c88-208e-4d13-8a93-dbb4f63a962f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:06.977624 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-15322c88-208e-4d13-8a93-dbb4f63a962f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:06.979679 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-15322c88-208e-4d13-8a93-dbb4f63a962f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:06.980418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-15322c88-208e-4d13-8a93-dbb4f63a962f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.164053 Aug 05 20:47:06.981252 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 235/437] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:06 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:07.379694 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-dcfb6aeb-808b-4ff9-8d9c-38b589c86459 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:07.380363 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-dcfb6aeb-808b-4ff9-8d9c-38b589c86459 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:07.388540 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dcfb6aeb-808b-4ff9-8d9c-38b589c86459 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:07.389050 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dcfb6aeb-808b-4ff9-8d9c-38b589c86459 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:07.389491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dcfb6aeb-808b-4ff9-8d9c-38b589c86459 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:07.390191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dcfb6aeb-808b-4ff9-8d9c-38b589c86459 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:07.390669 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dcfb6aeb-808b-4ff9-8d9c-38b589c86459 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:07.391094 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dcfb6aeb-808b-4ff9-8d9c-38b589c86459 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:07.531311 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-dcfb6aeb-808b-4ff9-8d9c-38b589c86459 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:07.539898 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-dcfb6aeb-808b-4ff9-8d9c-38b589c86459 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.165295 Aug 05 20:47:07.540845 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 236/438] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:07 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:07.672143 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-48e3a1d8-f91c-4cb4-ade2-f8e6563b31f4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:07.672755 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-48e3a1d8-f91c-4cb4-ade2-f8e6563b31f4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:07.678780 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48e3a1d8-f91c-4cb4-ade2-f8e6563b31f4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:07.679279 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48e3a1d8-f91c-4cb4-ade2-f8e6563b31f4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:07.679762 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48e3a1d8-f91c-4cb4-ade2-f8e6563b31f4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:07.680433 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48e3a1d8-f91c-4cb4-ade2-f8e6563b31f4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:07.680887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48e3a1d8-f91c-4cb4-ade2-f8e6563b31f4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:07.681311 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-48e3a1d8-f91c-4cb4-ade2-f8e6563b31f4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:07.816730 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-48e3a1d8-f91c-4cb4-ade2-f8e6563b31f4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:07.824562 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-48e3a1d8-f91c-4cb4-ade2-f8e6563b31f4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.156315 Aug 05 20:47:07.825121 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 237/439] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:07 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:08.004547 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f739e654-9d09-47b4-8afa-6978a80e2366 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:08.005273 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f739e654-9d09-47b4-8afa-6978a80e2366 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:08.012266 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f739e654-9d09-47b4-8afa-6978a80e2366 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:08.012752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f739e654-9d09-47b4-8afa-6978a80e2366 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:08.013184 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f739e654-9d09-47b4-8afa-6978a80e2366 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:08.013858 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f739e654-9d09-47b4-8afa-6978a80e2366 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:08.014306 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f739e654-9d09-47b4-8afa-6978a80e2366 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:08.014947 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f739e654-9d09-47b4-8afa-6978a80e2366 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:08.172395 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f739e654-9d09-47b4-8afa-6978a80e2366 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:08.182441 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f739e654-9d09-47b4-8afa-6978a80e2366 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:08.184182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f739e654-9d09-47b4-8afa-6978a80e2366 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:08.185393 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f739e654-9d09-47b4-8afa-6978a80e2366 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.185230 Aug 05 20:47:08.196482 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 238/440] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:07 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:47:08.562243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-796ee89f-2373-48cc-8ec8-cbac6e1ef0f0 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:08.563121 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-796ee89f-2373-48cc-8ec8-cbac6e1ef0f0 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:08.570990 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-796ee89f-2373-48cc-8ec8-cbac6e1ef0f0 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:08.571610 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-796ee89f-2373-48cc-8ec8-cbac6e1ef0f0 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:08.572052 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-796ee89f-2373-48cc-8ec8-cbac6e1ef0f0 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:08.572749 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-796ee89f-2373-48cc-8ec8-cbac6e1ef0f0 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:08.573254 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-796ee89f-2373-48cc-8ec8-cbac6e1ef0f0 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:08.573680 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-796ee89f-2373-48cc-8ec8-cbac6e1ef0f0 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:08.724306 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-6da2166d-0dfd-4e81-b4a1-06dc0ed5bc05 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "POST /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.098224 Aug 05 20:47:08.725310 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 203/441] 10.222.0.100 () {60 vars in 1328 bytes} [Fri Aug 5 20:46:54 2022] POST /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments => generated 194 bytes in 14100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:08.847402 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-b17c9e39-3924-431a-abf9-657c98e672cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:08.848257 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-b17c9e39-3924-431a-abf9-657c98e672cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:08.854747 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b17c9e39-3924-431a-abf9-657c98e672cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:08.855238 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b17c9e39-3924-431a-abf9-657c98e672cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:08.855701 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b17c9e39-3924-431a-abf9-657c98e672cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:08.856394 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b17c9e39-3924-431a-abf9-657c98e672cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:08.856846 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b17c9e39-3924-431a-abf9-657c98e672cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:08.857268 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b17c9e39-3924-431a-abf9-657c98e672cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:08.877079 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-796ee89f-2373-48cc-8ec8-cbac6e1ef0f0 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:08.896505 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-796ee89f-2373-48cc-8ec8-cbac6e1ef0f0 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.338668 Aug 05 20:47:08.897140 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 239/442] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:08 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:09.077804 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-b17c9e39-3924-431a-abf9-657c98e672cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:09.085685 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-b17c9e39-3924-431a-abf9-657c98e672cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.243257 Aug 05 20:47:09.086268 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 204/443] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:08 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:09.211857 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-96ffdbc9-4324-4711-b640-e2d9d6bff7d6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:09.212731 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-96ffdbc9-4324-4711-b640-e2d9d6bff7d6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:09.220926 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-96ffdbc9-4324-4711-b640-e2d9d6bff7d6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:09.221553 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-96ffdbc9-4324-4711-b640-e2d9d6bff7d6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:09.222671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-96ffdbc9-4324-4711-b640-e2d9d6bff7d6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:09.223408 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-96ffdbc9-4324-4711-b640-e2d9d6bff7d6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:09.223961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-96ffdbc9-4324-4711-b640-e2d9d6bff7d6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:09.224287 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-96ffdbc9-4324-4711-b640-e2d9d6bff7d6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:09.336843 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-198446365", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452"}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:09.378447 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-96ffdbc9-4324-4711-b640-e2d9d6bff7d6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:09.386984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-96ffdbc9-4324-4711-b640-e2d9d6bff7d6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:09.388478 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-96ffdbc9-4324-4711-b640-e2d9d6bff7d6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:09.389649 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-96ffdbc9-4324-4711-b640-e2d9d6bff7d6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.184069 Aug 05 20:47:09.390197 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 240/444] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:09 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:09.397856 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.network.neutron [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] validate_networks() for None {{(pid=124431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:47:09.680035 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Flavor limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:47:09.680515 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Image limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:47:09.681041 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Flavor pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:47:09.681541 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Image pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:47:09.682006 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:47:09.690926 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:09.691517 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:09.692002 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:09.692797 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:09.693312 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:09.693790 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:09.711173 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Getting quotas for project 0aae2e3faf47484886a5ccc86424b5c9. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:47:09.715080 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Getting quotas for user 6728c782d82146648c1b1de46866476d and project 0aae2e3faf47484886a5ccc86424b5c9. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:47:09.726389 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Going to run 1 instances... {{(pid=124431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:47:09.728677 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:47:09.773464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-30131a36-e8d0-4202-9b36-ed16fa5eab7f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.441470 Aug 05 20:47:09.774605 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 205/445] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:47:09 2022] POST /compute/v2.1/servers => generated 382 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:47:09.785361 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ee3db3fb-6ccc-4dcd-a63d-b16a971129e3 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:09.785977 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ee3db3fb-6ccc-4dcd-a63d-b16a971129e3 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:09.851953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ee3db3fb-6ccc-4dcd-a63d-b16a971129e3 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:09.862183 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ee3db3fb-6ccc-4dcd-a63d-b16a971129e3 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1218 microversion: 2.1 time: 0.080650 Aug 05 20:47:09.863201 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 241/446] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:09 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:09.917683 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9a19c90b-c802-41e3-90cc-13281812817c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:09.918312 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9a19c90b-c802-41e3-90cc-13281812817c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:09.925579 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9a19c90b-c802-41e3-90cc-13281812817c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:09.925889 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9a19c90b-c802-41e3-90cc-13281812817c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:09.926309 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9a19c90b-c802-41e3-90cc-13281812817c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:09.927106 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9a19c90b-c802-41e3-90cc-13281812817c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:09.927838 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9a19c90b-c802-41e3-90cc-13281812817c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:09.928254 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9a19c90b-c802-41e3-90cc-13281812817c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:10.101905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-9a19c90b-c802-41e3-90cc-13281812817c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:10.106938 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7149a3a9-9558-4224-902c-cba09726d399 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:10.108146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7149a3a9-9558-4224-902c-cba09726d399 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:10.110164 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9a19c90b-c802-41e3-90cc-13281812817c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.196571 Aug 05 20:47:10.110981 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 206/447] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:09 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:10.131290 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7149a3a9-9558-4224-902c-cba09726d399 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:10.131911 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7149a3a9-9558-4224-902c-cba09726d399 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:10.132271 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7149a3a9-9558-4224-902c-cba09726d399 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:10.132989 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7149a3a9-9558-4224-902c-cba09726d399 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:10.134033 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7149a3a9-9558-4224-902c-cba09726d399 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:10.134461 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7149a3a9-9558-4224-902c-cba09726d399 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:10.275773 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7149a3a9-9558-4224-902c-cba09726d399 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:10.283882 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7149a3a9-9558-4224-902c-cba09726d399 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.181782 Aug 05 20:47:10.284518 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 242/448] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:10 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:10.413611 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-325e1138-53ee-4564-b101-874d7748a1da tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:10.414148 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-325e1138-53ee-4564-b101-874d7748a1da tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:10.420311 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-325e1138-53ee-4564-b101-874d7748a1da tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:10.420837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-325e1138-53ee-4564-b101-874d7748a1da tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:10.421269 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-325e1138-53ee-4564-b101-874d7748a1da tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:10.421967 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-325e1138-53ee-4564-b101-874d7748a1da tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:10.422415 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-325e1138-53ee-4564-b101-874d7748a1da tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:10.422833 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-325e1138-53ee-4564-b101-874d7748a1da tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:10.563501 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-325e1138-53ee-4564-b101-874d7748a1da tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:10.573205 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-325e1138-53ee-4564-b101-874d7748a1da tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:10.574729 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-325e1138-53ee-4564-b101-874d7748a1da tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:10.575939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-325e1138-53ee-4564-b101-874d7748a1da tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.166624 Aug 05 20:47:10.576500 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 207/449] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:10 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:10.882698 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-af2a969a-a4c2-4776-9feb-84d63486b844 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:10.883346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-af2a969a-a4c2-4776-9feb-84d63486b844 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:10.890270 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af2a969a-a4c2-4776-9feb-84d63486b844 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:10.890783 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af2a969a-a4c2-4776-9feb-84d63486b844 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:10.891228 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af2a969a-a4c2-4776-9feb-84d63486b844 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:10.891963 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af2a969a-a4c2-4776-9feb-84d63486b844 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:10.892423 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af2a969a-a4c2-4776-9feb-84d63486b844 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:10.892872 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af2a969a-a4c2-4776-9feb-84d63486b844 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:10.957824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-af2a969a-a4c2-4776-9feb-84d63486b844 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:10.965641 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-af2a969a-a4c2-4776-9feb-84d63486b844 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1270 microversion: 2.1 time: 0.086912 Aug 05 20:47:10.966203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 243/450] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:10 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:11.134793 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-b09fab24-c397-48bb-ac4b-cca1b2b2c408 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:11.135654 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-b09fab24-c397-48bb-ac4b-cca1b2b2c408 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:11.146187 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b09fab24-c397-48bb-ac4b-cca1b2b2c408 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:11.146666 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b09fab24-c397-48bb-ac4b-cca1b2b2c408 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:11.147094 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b09fab24-c397-48bb-ac4b-cca1b2b2c408 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:11.147811 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b09fab24-c397-48bb-ac4b-cca1b2b2c408 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:11.148252 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b09fab24-c397-48bb-ac4b-cca1b2b2c408 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:11.148666 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b09fab24-c397-48bb-ac4b-cca1b2b2c408 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:11.296293 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-b09fab24-c397-48bb-ac4b-cca1b2b2c408 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:11.305838 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0ec2fafe-e195-4f10-9614-dbd270adeec2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:11.306313 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-b09fab24-c397-48bb-ac4b-cca1b2b2c408 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.177291 Aug 05 20:47:11.306582 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0ec2fafe-e195-4f10-9614-dbd270adeec2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:11.307547 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 208/451] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:11 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:11.314107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ec2fafe-e195-4f10-9614-dbd270adeec2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:11.314107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ec2fafe-e195-4f10-9614-dbd270adeec2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:11.314107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ec2fafe-e195-4f10-9614-dbd270adeec2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:11.314892 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ec2fafe-e195-4f10-9614-dbd270adeec2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:11.315557 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ec2fafe-e195-4f10-9614-dbd270adeec2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:11.315992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ec2fafe-e195-4f10-9614-dbd270adeec2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:11.471102 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0ec2fafe-e195-4f10-9614-dbd270adeec2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:11.486481 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0ec2fafe-e195-4f10-9614-dbd270adeec2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.185330 Aug 05 20:47:11.487985 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 244/452] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:11 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:11.600179 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-2f68d485-9aaf-41c6-9388-192d780bc6eb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:11.601289 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-2f68d485-9aaf-41c6-9388-192d780bc6eb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:11.611565 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f68d485-9aaf-41c6-9388-192d780bc6eb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:11.612597 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f68d485-9aaf-41c6-9388-192d780bc6eb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:11.613577 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f68d485-9aaf-41c6-9388-192d780bc6eb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:11.614824 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f68d485-9aaf-41c6-9388-192d780bc6eb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:11.615455 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f68d485-9aaf-41c6-9388-192d780bc6eb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:11.615915 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f68d485-9aaf-41c6-9388-192d780bc6eb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:11.627155 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-dc190515-07e8-487c-b291-a930f869a7d7 req-bb5e39e9-47b2-45ef-85ee-58beb6b41215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12ad125-6f29-4ee3-971f-d1c23391c89f", "name": "network-vif-plugged", "status": "completed", "tag": "aca05bcd-9297-4365-a6e9-dca538228f87"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:11.649639 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-dc190515-07e8-487c-b291-a930f869a7d7 req-bb5e39e9-47b2-45ef-85ee-58beb6b41215 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:11.650113 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-dc190515-07e8-487c-b291-a930f869a7d7 req-bb5e39e9-47b2-45ef-85ee-58beb6b41215 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:11.650650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-dc190515-07e8-487c-b291-a930f869a7d7 req-bb5e39e9-47b2-45ef-85ee-58beb6b41215 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:11.670287 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-dc190515-07e8-487c-b291-a930f869a7d7 req-bb5e39e9-47b2-45ef-85ee-58beb6b41215 service nova] Creating event network-vif-plugged:aca05bcd-9297-4365-a6e9-dca538228f87 for instance c12ad125-6f29-4ee3-971f-d1c23391c89f on hv-cinder-85220 Aug 05 20:47:11.678355 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-dc190515-07e8-487c-b291-a930f869a7d7 req-bb5e39e9-47b2-45ef-85ee-58beb6b41215 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055325 Aug 05 20:47:11.679682 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 245/453] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:47:11.782775 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2f68d485-9aaf-41c6-9388-192d780bc6eb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:11.792204 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2f68d485-9aaf-41c6-9388-192d780bc6eb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:11.793935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2f68d485-9aaf-41c6-9388-192d780bc6eb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:11.795453 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-2f68d485-9aaf-41c6-9388-192d780bc6eb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.199650 Aug 05 20:47:11.796072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 209/454] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:11 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:11.987174 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f8e934cc-a33a-40a3-8dd0-c79174f0b5ea tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:11.988668 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f8e934cc-a33a-40a3-8dd0-c79174f0b5ea tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:11.995504 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8e934cc-a33a-40a3-8dd0-c79174f0b5ea tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:11.995990 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8e934cc-a33a-40a3-8dd0-c79174f0b5ea tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:11.996597 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8e934cc-a33a-40a3-8dd0-c79174f0b5ea tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:11.997303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8e934cc-a33a-40a3-8dd0-c79174f0b5ea tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:11.997749 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8e934cc-a33a-40a3-8dd0-c79174f0b5ea tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:11.998347 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8e934cc-a33a-40a3-8dd0-c79174f0b5ea tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:12.079469 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f8e934cc-a33a-40a3-8dd0-c79174f0b5ea tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:12.088930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f8e934cc-a33a-40a3-8dd0-c79174f0b5ea tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1276 microversion: 2.1 time: 0.106542 Aug 05 20:47:12.089665 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 246/455] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:11 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:12.327838 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a1e3b4b4-ec20-429f-a5fd-c18e20cf25e7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:12.328414 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a1e3b4b4-ec20-429f-a5fd-c18e20cf25e7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:12.335746 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a1e3b4b4-ec20-429f-a5fd-c18e20cf25e7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:12.336466 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a1e3b4b4-ec20-429f-a5fd-c18e20cf25e7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:12.336899 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a1e3b4b4-ec20-429f-a5fd-c18e20cf25e7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:12.337595 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a1e3b4b4-ec20-429f-a5fd-c18e20cf25e7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:12.338037 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a1e3b4b4-ec20-429f-a5fd-c18e20cf25e7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:12.338461 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a1e3b4b4-ec20-429f-a5fd-c18e20cf25e7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:12.486845 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a1e3b4b4-ec20-429f-a5fd-c18e20cf25e7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:12.495684 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a1e3b4b4-ec20-429f-a5fd-c18e20cf25e7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1261 microversion: 2.1 time: 0.171726 Aug 05 20:47:12.496491 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 210/456] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:12 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:12.510500 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-15e0e0c3-aebc-4bc9-9b1d-5cfbc619aa56 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:12.511134 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-15e0e0c3-aebc-4bc9-9b1d-5cfbc619aa56 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:12.518945 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15e0e0c3-aebc-4bc9-9b1d-5cfbc619aa56 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:12.520084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15e0e0c3-aebc-4bc9-9b1d-5cfbc619aa56 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:12.520524 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15e0e0c3-aebc-4bc9-9b1d-5cfbc619aa56 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:12.521238 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15e0e0c3-aebc-4bc9-9b1d-5cfbc619aa56 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:12.521883 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15e0e0c3-aebc-4bc9-9b1d-5cfbc619aa56 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:12.522317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15e0e0c3-aebc-4bc9-9b1d-5cfbc619aa56 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:12.525388 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:12.665514 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-15e0e0c3-aebc-4bc9-9b1d-5cfbc619aa56 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:12.673566 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-15e0e0c3-aebc-4bc9-9b1d-5cfbc619aa56 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.167001 Aug 05 20:47:12.674270 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 247/457] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:12 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:12.819849 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-49058caa-f3a1-4c0d-afba-847219421f43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:12.820463 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-49058caa-f3a1-4c0d-afba-847219421f43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:12.826939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-49058caa-f3a1-4c0d-afba-847219421f43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:12.827454 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-49058caa-f3a1-4c0d-afba-847219421f43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:12.827922 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-49058caa-f3a1-4c0d-afba-847219421f43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:12.828627 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-49058caa-f3a1-4c0d-afba-847219421f43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:12.829152 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-49058caa-f3a1-4c0d-afba-847219421f43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:12.829600 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-49058caa-f3a1-4c0d-afba-847219421f43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:12.972367 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-49058caa-f3a1-4c0d-afba-847219421f43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:12.981314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-49058caa-f3a1-4c0d-afba-847219421f43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:12.982842 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-49058caa-f3a1-4c0d-afba-847219421f43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:12.984057 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-49058caa-f3a1-4c0d-afba-847219421f43 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.169713 Aug 05 20:47:12.984619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 211/458] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:12 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:13.110440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-72e1d728-3b38-421d-a4f5-7c5ffbad86c0 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:13.111055 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-72e1d728-3b38-421d-a4f5-7c5ffbad86c0 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:13.118240 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72e1d728-3b38-421d-a4f5-7c5ffbad86c0 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:13.118738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72e1d728-3b38-421d-a4f5-7c5ffbad86c0 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:13.119175 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72e1d728-3b38-421d-a4f5-7c5ffbad86c0 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:13.119908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72e1d728-3b38-421d-a4f5-7c5ffbad86c0 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:13.120365 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72e1d728-3b38-421d-a4f5-7c5ffbad86c0 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:13.120924 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-72e1d728-3b38-421d-a4f5-7c5ffbad86c0 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:13.125847 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-cd5268e6-5bea-4ce9-8aaa-594c9017c987 req-fd713885-0c04-4a12-80ed-403a1ef5445b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c4191a-faac-40d1-856c-fb7de0c5306f", "tag": "384a9c0c-aebc-4a88-a701-c99655bee7c7"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:13.135728 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-cd5268e6-5bea-4ce9-8aaa-594c9017c987 req-fd713885-0c04-4a12-80ed-403a1ef5445b service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:13.136449 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-cd5268e6-5bea-4ce9-8aaa-594c9017c987 req-fd713885-0c04-4a12-80ed-403a1ef5445b service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:13.136884 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-cd5268e6-5bea-4ce9-8aaa-594c9017c987 req-fd713885-0c04-4a12-80ed-403a1ef5445b service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:13.148868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-cd5268e6-5bea-4ce9-8aaa-594c9017c987 req-fd713885-0c04-4a12-80ed-403a1ef5445b service nova] Creating event network-changed:384a9c0c-aebc-4a88-a701-c99655bee7c7 for instance 75c4191a-faac-40d1-856c-fb7de0c5306f on hv-cinder-85220 Aug 05 20:47:13.154772 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-cd5268e6-5bea-4ce9-8aaa-594c9017c987 req-fd713885-0c04-4a12-80ed-403a1ef5445b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032320 Aug 05 20:47:13.155420 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 212/459] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:47:13.255437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-72e1d728-3b38-421d-a4f5-7c5ffbad86c0 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:13.263108 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-72e1d728-3b38-421d-a4f5-7c5ffbad86c0 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1318 microversion: 2.1 time: 0.156542 Aug 05 20:47:13.263695 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 248/460] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:13 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:13.518357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-cfd02475-5f7c-4092-add2-a7f112bb818d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:13.519104 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-cfd02475-5f7c-4092-add2-a7f112bb818d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:13.525687 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cfd02475-5f7c-4092-add2-a7f112bb818d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:13.526170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cfd02475-5f7c-4092-add2-a7f112bb818d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:13.526611 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cfd02475-5f7c-4092-add2-a7f112bb818d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:13.527306 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cfd02475-5f7c-4092-add2-a7f112bb818d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:13.527790 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cfd02475-5f7c-4092-add2-a7f112bb818d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:13.528217 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cfd02475-5f7c-4092-add2-a7f112bb818d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:13.662330 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-cfd02475-5f7c-4092-add2-a7f112bb818d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:13.670069 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-cfd02475-5f7c-4092-add2-a7f112bb818d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1445 microversion: 2.1 time: 0.156646 Aug 05 20:47:13.670676 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 213/461] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:13 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:13.690872 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b825a1bf-22e6-4ef9-bf8e-a3bb35b5986b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:13.691615 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b825a1bf-22e6-4ef9-bf8e-a3bb35b5986b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:13.695266 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-131c65ff-771e-46ce-831c-bddf373392cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:13.696238 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-131c65ff-771e-46ce-831c-bddf373392cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:13.699673 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b825a1bf-22e6-4ef9-bf8e-a3bb35b5986b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:13.700174 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b825a1bf-22e6-4ef9-bf8e-a3bb35b5986b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:13.700777 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b825a1bf-22e6-4ef9-bf8e-a3bb35b5986b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:13.701807 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b825a1bf-22e6-4ef9-bf8e-a3bb35b5986b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:13.702952 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b825a1bf-22e6-4ef9-bf8e-a3bb35b5986b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:13.703806 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b825a1bf-22e6-4ef9-bf8e-a3bb35b5986b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:13.704678 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-131c65ff-771e-46ce-831c-bddf373392cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:13.705428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-131c65ff-771e-46ce-831c-bddf373392cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:13.706016 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-131c65ff-771e-46ce-831c-bddf373392cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:13.706948 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-131c65ff-771e-46ce-831c-bddf373392cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:13.707633 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-131c65ff-771e-46ce-831c-bddf373392cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:13.708177 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-131c65ff-771e-46ce-831c-bddf373392cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:13.908133 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b825a1bf-22e6-4ef9-bf8e-a3bb35b5986b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:13.913317 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-131c65ff-771e-46ce-831c-bddf373392cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:13.920077 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b825a1bf-22e6-4ef9-bf8e-a3bb35b5986b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1445 microversion: 2.1 time: 0.232646 Aug 05 20:47:13.921132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 249/462] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:13 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1445 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:13.925543 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-131c65ff-771e-46ce-831c-bddf373392cf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.233872 Aug 05 20:47:13.926263 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 214/463] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:13 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:14.009415 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6e2f2079-5e89-453f-bb65-5d8868aa71cd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:14.010106 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6e2f2079-5e89-453f-bb65-5d8868aa71cd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:14.016534 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e2f2079-5e89-453f-bb65-5d8868aa71cd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:14.017079 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e2f2079-5e89-453f-bb65-5d8868aa71cd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:14.017511 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e2f2079-5e89-453f-bb65-5d8868aa71cd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:14.018368 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e2f2079-5e89-453f-bb65-5d8868aa71cd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:14.019513 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e2f2079-5e89-453f-bb65-5d8868aa71cd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:14.019951 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e2f2079-5e89-453f-bb65-5d8868aa71cd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:14.163590 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6e2f2079-5e89-453f-bb65-5d8868aa71cd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:14.174853 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6e2f2079-5e89-453f-bb65-5d8868aa71cd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:14.176518 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6e2f2079-5e89-453f-bb65-5d8868aa71cd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:14.177701 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6e2f2079-5e89-453f-bb65-5d8868aa71cd tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.172671 Aug 05 20:47:14.178261 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 250/464] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:14 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:14.283990 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-96878c53-da76-4560-a4ad-24b6fe444895 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:14.284830 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-96878c53-da76-4560-a4ad-24b6fe444895 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:14.290962 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-96878c53-da76-4560-a4ad-24b6fe444895 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:14.291494 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-96878c53-da76-4560-a4ad-24b6fe444895 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:14.291958 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-96878c53-da76-4560-a4ad-24b6fe444895 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:14.292658 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-96878c53-da76-4560-a4ad-24b6fe444895 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:14.293111 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-96878c53-da76-4560-a4ad-24b6fe444895 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:14.293537 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-96878c53-da76-4560-a4ad-24b6fe444895 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:14.441874 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-96878c53-da76-4560-a4ad-24b6fe444895 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:14.450372 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-96878c53-da76-4560-a4ad-24b6fe444895 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1318 microversion: 2.1 time: 0.170591 Aug 05 20:47:14.450912 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 215/465] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:14 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:14.950236 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5ecd4a90-7666-4b84-aa13-211b4bf5c110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:14.950839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5ecd4a90-7666-4b84-aa13-211b4bf5c110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:14.957646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ecd4a90-7666-4b84-aa13-211b4bf5c110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:14.958167 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ecd4a90-7666-4b84-aa13-211b4bf5c110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:14.958591 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ecd4a90-7666-4b84-aa13-211b4bf5c110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:14.959294 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ecd4a90-7666-4b84-aa13-211b4bf5c110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:14.959805 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ecd4a90-7666-4b84-aa13-211b4bf5c110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:14.960228 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5ecd4a90-7666-4b84-aa13-211b4bf5c110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:15.095594 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5ecd4a90-7666-4b84-aa13-211b4bf5c110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:15.104056 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5ecd4a90-7666-4b84-aa13-211b4bf5c110 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.158021 Aug 05 20:47:15.109692 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 251/466] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:14 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:15.200856 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d65a09f1-1f19-4865-a13d-530226f73e8e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:15.201377 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d65a09f1-1f19-4865-a13d-530226f73e8e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:15.208300 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d65a09f1-1f19-4865-a13d-530226f73e8e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:15.208763 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d65a09f1-1f19-4865-a13d-530226f73e8e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:15.209194 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d65a09f1-1f19-4865-a13d-530226f73e8e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:15.209896 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d65a09f1-1f19-4865-a13d-530226f73e8e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:15.210371 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d65a09f1-1f19-4865-a13d-530226f73e8e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:15.210812 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d65a09f1-1f19-4865-a13d-530226f73e8e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:15.340447 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d65a09f1-1f19-4865-a13d-530226f73e8e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:15.352003 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d65a09f1-1f19-4865-a13d-530226f73e8e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:15.353612 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d65a09f1-1f19-4865-a13d-530226f73e8e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:15.354793 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d65a09f1-1f19-4865-a13d-530226f73e8e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.158154 Aug 05 20:47:15.355699 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 216/467] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:15 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:15.471780 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-39e7a13a-a10d-4458-a927-6af1044900d2 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:15.472552 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-39e7a13a-a10d-4458-a927-6af1044900d2 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:15.479177 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-39e7a13a-a10d-4458-a927-6af1044900d2 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:15.479700 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-39e7a13a-a10d-4458-a927-6af1044900d2 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:15.480144 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-39e7a13a-a10d-4458-a927-6af1044900d2 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:15.480854 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-39e7a13a-a10d-4458-a927-6af1044900d2 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:15.481311 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-39e7a13a-a10d-4458-a927-6af1044900d2 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:15.481736 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-39e7a13a-a10d-4458-a927-6af1044900d2 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:15.616570 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-39e7a13a-a10d-4458-a927-6af1044900d2 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:15.624697 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-39e7a13a-a10d-4458-a927-6af1044900d2 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1318 microversion: 2.1 time: 0.157131 Aug 05 20:47:15.625264 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 252/468] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:15 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:15.893800 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-fd115614-b902-4097-8052-0a6a4742f8a6 req-0eaa7a67-910e-41cb-a517-a41d5eb50465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12ad125-6f29-4ee3-971f-d1c23391c89f", "tag": "aca05bcd-9297-4365-a6e9-dca538228f87"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:15.903802 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-fd115614-b902-4097-8052-0a6a4742f8a6 req-0eaa7a67-910e-41cb-a517-a41d5eb50465 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:15.904590 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-fd115614-b902-4097-8052-0a6a4742f8a6 req-0eaa7a67-910e-41cb-a517-a41d5eb50465 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:15.905053 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-fd115614-b902-4097-8052-0a6a4742f8a6 req-0eaa7a67-910e-41cb-a517-a41d5eb50465 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:15.916511 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-fd115614-b902-4097-8052-0a6a4742f8a6 req-0eaa7a67-910e-41cb-a517-a41d5eb50465 service nova] Creating event network-changed:aca05bcd-9297-4365-a6e9-dca538228f87 for instance c12ad125-6f29-4ee3-971f-d1c23391c89f on hv-cinder-85220 Aug 05 20:47:15.921767 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-fd115614-b902-4097-8052-0a6a4742f8a6 req-0eaa7a67-910e-41cb-a517-a41d5eb50465 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031981 Aug 05 20:47:15.922848 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 217/469] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:16.125051 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b42dccb6-177d-4927-a4fe-b3440c5fecbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:16.125602 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b42dccb6-177d-4927-a4fe-b3440c5fecbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:16.132399 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b42dccb6-177d-4927-a4fe-b3440c5fecbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:16.132892 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b42dccb6-177d-4927-a4fe-b3440c5fecbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:16.133332 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b42dccb6-177d-4927-a4fe-b3440c5fecbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:16.134026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b42dccb6-177d-4927-a4fe-b3440c5fecbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:16.134621 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b42dccb6-177d-4927-a4fe-b3440c5fecbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:16.135051 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b42dccb6-177d-4927-a4fe-b3440c5fecbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:16.379958 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0771a7b5-f760-42bb-8d05-8176d34fb614 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:16.380529 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0771a7b5-f760-42bb-8d05-8176d34fb614 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:16.387010 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0771a7b5-f760-42bb-8d05-8176d34fb614 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:16.387564 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0771a7b5-f760-42bb-8d05-8176d34fb614 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:16.387999 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0771a7b5-f760-42bb-8d05-8176d34fb614 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:16.388709 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0771a7b5-f760-42bb-8d05-8176d34fb614 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:16.389194 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0771a7b5-f760-42bb-8d05-8176d34fb614 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:16.389619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0771a7b5-f760-42bb-8d05-8176d34fb614 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:16.614747 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b42dccb6-177d-4927-a4fe-b3440c5fecbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:16.617251 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0771a7b5-f760-42bb-8d05-8176d34fb614 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:16.623236 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b42dccb6-177d-4927-a4fe-b3440c5fecbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.502249 Aug 05 20:47:16.624305 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 253/470] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:16 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:16.626437 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0771a7b5-f760-42bb-8d05-8176d34fb614 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:16.628088 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0771a7b5-f760-42bb-8d05-8176d34fb614 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:16.629613 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0771a7b5-f760-42bb-8d05-8176d34fb614 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.255188 Aug 05 20:47:16.630360 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 218/471] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:16 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:16.645642 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ded50269-c089-4bcc-8c00-bf121313ee66 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:16.646387 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ded50269-c089-4bcc-8c00-bf121313ee66 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:16.648365 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:16.654667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ded50269-c089-4bcc-8c00-bf121313ee66 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:16.655163 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ded50269-c089-4bcc-8c00-bf121313ee66 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:16.655623 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ded50269-c089-4bcc-8c00-bf121313ee66 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:16.656407 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ded50269-c089-4bcc-8c00-bf121313ee66 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:16.656880 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ded50269-c089-4bcc-8c00-bf121313ee66 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:16.657216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ded50269-c089-4bcc-8c00-bf121313ee66 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:16.798512 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ded50269-c089-4bcc-8c00-bf121313ee66 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:16.808265 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ded50269-c089-4bcc-8c00-bf121313ee66 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1318 microversion: 2.1 time: 0.166615 Aug 05 20:47:16.810497 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 254/472] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:16 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:17.659231 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-14384262-927e-4d59-8e2e-256efe0f7b43 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:17.659815 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-14384262-927e-4d59-8e2e-256efe0f7b43 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:17.665900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a90e0bf7-6df4-4146-8d1d-38d2ce12afc1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:17.666902 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-14384262-927e-4d59-8e2e-256efe0f7b43 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:17.667428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-14384262-927e-4d59-8e2e-256efe0f7b43 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:17.667873 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-14384262-927e-4d59-8e2e-256efe0f7b43 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:17.668594 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-14384262-927e-4d59-8e2e-256efe0f7b43 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:17.669060 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-14384262-927e-4d59-8e2e-256efe0f7b43 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:17.669387 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a90e0bf7-6df4-4146-8d1d-38d2ce12afc1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:17.669524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-14384262-927e-4d59-8e2e-256efe0f7b43 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:17.683894 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a90e0bf7-6df4-4146-8d1d-38d2ce12afc1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:17.685138 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a90e0bf7-6df4-4146-8d1d-38d2ce12afc1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:17.688268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a90e0bf7-6df4-4146-8d1d-38d2ce12afc1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:17.689501 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a90e0bf7-6df4-4146-8d1d-38d2ce12afc1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:17.691555 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a90e0bf7-6df4-4146-8d1d-38d2ce12afc1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:17.692201 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a90e0bf7-6df4-4146-8d1d-38d2ce12afc1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:17.874524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-14384262-927e-4d59-8e2e-256efe0f7b43 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:17.882182 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-14384262-927e-4d59-8e2e-256efe0f7b43 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.228615 Aug 05 20:47:17.882758 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 219/473] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:17 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:17.887203 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-62d616b3-84a0-48bb-b323-547143243eca tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:17.887847 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-62d616b3-84a0-48bb-b323-547143243eca tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:17.893523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-62d616b3-84a0-48bb-b323-547143243eca tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:17.894020 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-62d616b3-84a0-48bb-b323-547143243eca tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:17.894724 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-62d616b3-84a0-48bb-b323-547143243eca tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:17.895481 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-62d616b3-84a0-48bb-b323-547143243eca tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:17.895936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-62d616b3-84a0-48bb-b323-547143243eca tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:17.896369 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-62d616b3-84a0-48bb-b323-547143243eca tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:17.900267 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a90e0bf7-6df4-4146-8d1d-38d2ce12afc1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:17.909046 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a90e0bf7-6df4-4146-8d1d-38d2ce12afc1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:17.911247 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a90e0bf7-6df4-4146-8d1d-38d2ce12afc1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:17.912486 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a90e0bf7-6df4-4146-8d1d-38d2ce12afc1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.255510 Aug 05 20:47:17.913336 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 255/474] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:17 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:47:18.057005 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-62d616b3-84a0-48bb-b323-547143243eca tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:18.065743 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-62d616b3-84a0-48bb-b323-547143243eca tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1318 microversion: 2.1 time: 0.181644 Aug 05 20:47:18.066398 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 220/475] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:17 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:18.554385 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-32aa782b-5367-4ead-9f7c-86a0f8f3663e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:18.554999 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-32aa782b-5367-4ead-9f7c-86a0f8f3663e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:18.561309 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-32aa782b-5367-4ead-9f7c-86a0f8f3663e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:18.561801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-32aa782b-5367-4ead-9f7c-86a0f8f3663e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:18.562241 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-32aa782b-5367-4ead-9f7c-86a0f8f3663e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:18.562947 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-32aa782b-5367-4ead-9f7c-86a0f8f3663e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:18.563424 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-32aa782b-5367-4ead-9f7c-86a0f8f3663e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:18.563852 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-32aa782b-5367-4ead-9f7c-86a0f8f3663e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:18.701549 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-32aa782b-5367-4ead-9f7c-86a0f8f3663e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:18.710014 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-32aa782b-5367-4ead-9f7c-86a0f8f3663e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1597 microversion: 2.1 time: 0.159593 Aug 05 20:47:18.710598 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 256/476] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:18 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:18.903283 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f729985d-46db-446e-83af-dcb050922b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:18.904020 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f729985d-46db-446e-83af-dcb050922b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:18.911461 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f729985d-46db-446e-83af-dcb050922b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:18.912082 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f729985d-46db-446e-83af-dcb050922b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:18.912544 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f729985d-46db-446e-83af-dcb050922b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:18.913265 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f729985d-46db-446e-83af-dcb050922b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:18.913915 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f729985d-46db-446e-83af-dcb050922b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:18.914348 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f729985d-46db-446e-83af-dcb050922b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:18.918772 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:18.939203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-23b64847-8c53-41cd-a7fa-1de1b344ac9e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:18.940026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-23b64847-8c53-41cd-a7fa-1de1b344ac9e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:18.947403 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-23b64847-8c53-41cd-a7fa-1de1b344ac9e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:18.948257 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-23b64847-8c53-41cd-a7fa-1de1b344ac9e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:18.949047 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-23b64847-8c53-41cd-a7fa-1de1b344ac9e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:18.950251 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-23b64847-8c53-41cd-a7fa-1de1b344ac9e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:18.965135 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-23b64847-8c53-41cd-a7fa-1de1b344ac9e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:18.967303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-23b64847-8c53-41cd-a7fa-1de1b344ac9e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:19.129051 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f729985d-46db-446e-83af-dcb050922b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:19.137005 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f729985d-46db-446e-83af-dcb050922b59 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.237647 Aug 05 20:47:19.137581 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 221/477] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:18 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:19.142249 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8f2b92b9-f61d-40f2-870c-e6056c592b4c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:19.142988 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8f2b92b9-f61d-40f2-870c-e6056c592b4c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:19.152822 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-23b64847-8c53-41cd-a7fa-1de1b344ac9e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:19.156918 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8f2b92b9-f61d-40f2-870c-e6056c592b4c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:19.157438 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8f2b92b9-f61d-40f2-870c-e6056c592b4c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:19.157870 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8f2b92b9-f61d-40f2-870c-e6056c592b4c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:19.158581 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8f2b92b9-f61d-40f2-870c-e6056c592b4c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:19.159098 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8f2b92b9-f61d-40f2-870c-e6056c592b4c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:19.159544 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8f2b92b9-f61d-40f2-870c-e6056c592b4c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:19.162857 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-23b64847-8c53-41cd-a7fa-1de1b344ac9e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:19.164675 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-23b64847-8c53-41cd-a7fa-1de1b344ac9e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:19.166209 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-23b64847-8c53-41cd-a7fa-1de1b344ac9e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.232302 Aug 05 20:47:19.166777 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 257/478] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:18 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:19.304436 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8f2b92b9-f61d-40f2-870c-e6056c592b4c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:19.312861 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8f2b92b9-f61d-40f2-870c-e6056c592b4c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1318 microversion: 2.1 time: 0.174110 Aug 05 20:47:19.314380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 222/479] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:19 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:19.775698 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-ba455109-7328-4111-8d72-7177a00bd512 req-bdca5c89-8c23-4a90-98da-c7092b8ce6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20537f07-e2b8-4c88-8757-58c0b37570d2", "name": "network-vif-plugged", "status": "completed", "tag": "a196cd1a-7fd3-4c91-8b4f-d500d0c2740a"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:19.787198 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-ba455109-7328-4111-8d72-7177a00bd512 req-bdca5c89-8c23-4a90-98da-c7092b8ce6b9 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:19.787938 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-ba455109-7328-4111-8d72-7177a00bd512 req-bdca5c89-8c23-4a90-98da-c7092b8ce6b9 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:19.788433 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-ba455109-7328-4111-8d72-7177a00bd512 req-bdca5c89-8c23-4a90-98da-c7092b8ce6b9 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:19.804107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-ba455109-7328-4111-8d72-7177a00bd512 req-bdca5c89-8c23-4a90-98da-c7092b8ce6b9 service nova] Creating event network-vif-plugged:a196cd1a-7fd3-4c91-8b4f-d500d0c2740a for instance 20537f07-e2b8-4c88-8757-58c0b37570d2 on hv-cinder-85220 Aug 05 20:47:19.810474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-ba455109-7328-4111-8d72-7177a00bd512 req-bdca5c89-8c23-4a90-98da-c7092b8ce6b9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038934 Aug 05 20:47:19.811339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 258/480] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:20.158695 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-17cb0e4b-a615-457a-acbf-fbd3a0cc703e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:20.159384 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-17cb0e4b-a615-457a-acbf-fbd3a0cc703e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:20.161543 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:20.162268 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=6 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:20.169105 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-17cb0e4b-a615-457a-acbf-fbd3a0cc703e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:20.169517 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-17cb0e4b-a615-457a-acbf-fbd3a0cc703e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:20.170043 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-17cb0e4b-a615-457a-acbf-fbd3a0cc703e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:20.170747 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-17cb0e4b-a615-457a-acbf-fbd3a0cc703e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:20.171197 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-17cb0e4b-a615-457a-acbf-fbd3a0cc703e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:20.171665 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-17cb0e4b-a615-457a-acbf-fbd3a0cc703e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:20.190478 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1a95b880-e387-4d56-949e-5a8a470b922e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:20.191667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1a95b880-e387-4d56-949e-5a8a470b922e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:20.193753 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:20.199947 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1a95b880-e387-4d56-949e-5a8a470b922e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:20.200568 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1a95b880-e387-4d56-949e-5a8a470b922e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:20.201120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1a95b880-e387-4d56-949e-5a8a470b922e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:20.202086 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1a95b880-e387-4d56-949e-5a8a470b922e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:20.202625 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1a95b880-e387-4d56-949e-5a8a470b922e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:20.203166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1a95b880-e387-4d56-949e-5a8a470b922e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:20.387756 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-17cb0e4b-a615-457a-acbf-fbd3a0cc703e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:20.398637 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-17cb0e4b-a615-457a-acbf-fbd3a0cc703e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.244228 Aug 05 20:47:20.399233 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 223/481] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:20 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:20.421693 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1a95b880-e387-4d56-949e-5a8a470b922e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:20.432172 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1a95b880-e387-4d56-949e-5a8a470b922e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:20.434889 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1a95b880-e387-4d56-949e-5a8a470b922e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:20.436568 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1a95b880-e387-4d56-949e-5a8a470b922e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.250377 Aug 05 20:47:20.437933 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-5ea54654-2cb7-4128-8423-96377370c4d1 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:20.438663 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-5ea54654-2cb7-4128-8423-96377370c4d1 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:20.447021 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ea54654-2cb7-4128-8423-96377370c4d1 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:20.447992 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ea54654-2cb7-4128-8423-96377370c4d1 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:20.448509 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 259/482] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:20 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:20.449104 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ea54654-2cb7-4128-8423-96377370c4d1 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:20.449973 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ea54654-2cb7-4128-8423-96377370c4d1 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:20.450578 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ea54654-2cb7-4128-8423-96377370c4d1 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:20.451135 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ea54654-2cb7-4128-8423-96377370c4d1 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:20.630210 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-5ea54654-2cb7-4128-8423-96377370c4d1 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:20.638763 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-5ea54654-2cb7-4128-8423-96377370c4d1 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1318 microversion: 2.1 time: 0.216380 Aug 05 20:47:20.639309 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 224/483] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:20 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:20.768784 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-b7c0f403-981f-476b-a590-829a513dd996 req-ec422f63-f28e-456d-91d8-cefcba5fb4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a270d6db-218c-4081-81b9-b161dc70a7bb", "tag": "ff5e6ab7-ec2b-46dd-b050-f4b9bceff071"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:20.779822 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-b7c0f403-981f-476b-a590-829a513dd996 req-ec422f63-f28e-456d-91d8-cefcba5fb4f7 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:20.780542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-b7c0f403-981f-476b-a590-829a513dd996 req-ec422f63-f28e-456d-91d8-cefcba5fb4f7 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:20.780726 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-b7c0f403-981f-476b-a590-829a513dd996 req-ec422f63-f28e-456d-91d8-cefcba5fb4f7 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:20.796973 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-b7c0f403-981f-476b-a590-829a513dd996 req-ec422f63-f28e-456d-91d8-cefcba5fb4f7 service nova] Creating event network-changed:ff5e6ab7-ec2b-46dd-b050-f4b9bceff071 for instance a270d6db-218c-4081-81b9-b161dc70a7bb on hv-cinder-85220 Aug 05 20:47:20.802418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-b7c0f403-981f-476b-a590-829a513dd996 req-ec422f63-f28e-456d-91d8-cefcba5fb4f7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037512 Aug 05 20:47:20.803022 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 260/484] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:21.421443 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-55482912-afb2-481a-b002-7b0bffb5e3c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:21.422396 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-55482912-afb2-481a-b002-7b0bffb5e3c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:21.429951 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-55482912-afb2-481a-b002-7b0bffb5e3c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:21.430443 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-55482912-afb2-481a-b002-7b0bffb5e3c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:21.430856 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-55482912-afb2-481a-b002-7b0bffb5e3c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:21.431791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-55482912-afb2-481a-b002-7b0bffb5e3c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:21.432477 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-55482912-afb2-481a-b002-7b0bffb5e3c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:21.432900 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-55482912-afb2-481a-b002-7b0bffb5e3c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:21.465681 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c40b5673-0049-4ba1-9f95-fd20d3fc4ced tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:21.466743 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c40b5673-0049-4ba1-9f95-fd20d3fc4ced tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:21.475452 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c40b5673-0049-4ba1-9f95-fd20d3fc4ced tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:21.476385 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c40b5673-0049-4ba1-9f95-fd20d3fc4ced tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:21.482714 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c40b5673-0049-4ba1-9f95-fd20d3fc4ced tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:21.483696 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c40b5673-0049-4ba1-9f95-fd20d3fc4ced tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:21.484794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c40b5673-0049-4ba1-9f95-fd20d3fc4ced tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:21.485388 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c40b5673-0049-4ba1-9f95-fd20d3fc4ced tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:21.723269 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-55482912-afb2-481a-b002-7b0bffb5e3c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:21.732677 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-55482912-afb2-481a-b002-7b0bffb5e3c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.316358 Aug 05 20:47:21.736317 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 225/485] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:21 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:21.742823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-b33fbc93-0cde-44a6-b92e-6a28e0dac48e tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:21.743470 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-b33fbc93-0cde-44a6-b92e-6a28e0dac48e tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:21.762864 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b33fbc93-0cde-44a6-b92e-6a28e0dac48e tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:21.763688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b33fbc93-0cde-44a6-b92e-6a28e0dac48e tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:21.771014 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b33fbc93-0cde-44a6-b92e-6a28e0dac48e tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:21.771950 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b33fbc93-0cde-44a6-b92e-6a28e0dac48e tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:21.772446 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b33fbc93-0cde-44a6-b92e-6a28e0dac48e tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:21.772904 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b33fbc93-0cde-44a6-b92e-6a28e0dac48e tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:21.799751 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c40b5673-0049-4ba1-9f95-fd20d3fc4ced tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:21.811771 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c40b5673-0049-4ba1-9f95-fd20d3fc4ced tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:21.813309 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c40b5673-0049-4ba1-9f95-fd20d3fc4ced tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:21.814515 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c40b5673-0049-4ba1-9f95-fd20d3fc4ced tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.356191 Aug 05 20:47:21.820538 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 261/486] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:21 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:21.835933 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-705100d2-4649-428d-bd8c-88404096b6b1 req-0e97792c-6530-4e6b-9b2a-741e8c2b9718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c4191a-faac-40d1-856c-fb7de0c5306f", "name": "network-vif-plugged", "status": "completed", "tag": "384a9c0c-aebc-4a88-a701-c99655bee7c7"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:21.845802 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-705100d2-4649-428d-bd8c-88404096b6b1 req-0e97792c-6530-4e6b-9b2a-741e8c2b9718 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:21.846609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-705100d2-4649-428d-bd8c-88404096b6b1 req-0e97792c-6530-4e6b-9b2a-741e8c2b9718 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:21.847435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-705100d2-4649-428d-bd8c-88404096b6b1 req-0e97792c-6530-4e6b-9b2a-741e8c2b9718 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:21.859192 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-705100d2-4649-428d-bd8c-88404096b6b1 req-0e97792c-6530-4e6b-9b2a-741e8c2b9718 service nova] Creating event network-vif-plugged:384a9c0c-aebc-4a88-a701-c99655bee7c7 for instance 75c4191a-faac-40d1-856c-fb7de0c5306f on hv-cinder-85220 Aug 05 20:47:21.865229 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-705100d2-4649-428d-bd8c-88404096b6b1 req-0e97792c-6530-4e6b-9b2a-741e8c2b9718 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032960 Aug 05 20:47:21.866732 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 262/487] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:47:22.038661 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-b33fbc93-0cde-44a6-b92e-6a28e0dac48e tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:22.046647 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-b33fbc93-0cde-44a6-b92e-6a28e0dac48e tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1318 microversion: 2.1 time: 0.309124 Aug 05 20:47:22.059593 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 226/488] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:21 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:22.172278 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-569b6ded-bb0d-4254-b7ec-4217120c273f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-662722441"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:22.174199 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-569b6ded-bb0d-4254-b7ec-4217120c273f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:22.184936 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-569b6ded-bb0d-4254-b7ec-4217120c273f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:22.185915 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-569b6ded-bb0d-4254-b7ec-4217120c273f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:22.186830 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-569b6ded-bb0d-4254-b7ec-4217120c273f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:22.188279 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-569b6ded-bb0d-4254-b7ec-4217120c273f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:22.189202 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-569b6ded-bb0d-4254-b7ec-4217120c273f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:22.191070 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-569b6ded-bb0d-4254-b7ec-4217120c273f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:22.332694 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.network.security_group_api [None req-569b6ded-bb0d-4254-b7ec-4217120c273f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Adding security group 8bf9f684-a512-4fb8-add3-255d631545a7 to port ff5e6ab7-ec2b-46dd-b050-f4b9bceff071 Aug 05 20:47:22.662041 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-569b6ded-bb0d-4254-b7ec-4217120c273f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "POST /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.498374 Aug 05 20:47:22.662806 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 263/489] 10.222.0.100 () {60 vars in 1283 bytes} [Fri Aug 5 20:47:22 2022] POST /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:47:22.671000 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-98bd2e42-f1a1-4a2f-acd7-e5cc377c7028 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:22.671875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-98bd2e42-f1a1-4a2f-acd7-e5cc377c7028 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:22.682209 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-2434fc8e-54d4-4e9d-9fa9-b8efd19502a5 req-3ec8b319-19f2-4fa3-8c45-8704442e3866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a270d6db-218c-4081-81b9-b161dc70a7bb", "tag": "ff5e6ab7-ec2b-46dd-b050-f4b9bceff071"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:22.684181 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-98bd2e42-f1a1-4a2f-acd7-e5cc377c7028 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:22.690250 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-98bd2e42-f1a1-4a2f-acd7-e5cc377c7028 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:22.690899 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-98bd2e42-f1a1-4a2f-acd7-e5cc377c7028 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:22.691679 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-98bd2e42-f1a1-4a2f-acd7-e5cc377c7028 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:22.692392 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-98bd2e42-f1a1-4a2f-acd7-e5cc377c7028 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:22.693318 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-98bd2e42-f1a1-4a2f-acd7-e5cc377c7028 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:22.703340 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-2434fc8e-54d4-4e9d-9fa9-b8efd19502a5 req-3ec8b319-19f2-4fa3-8c45-8704442e3866 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:22.704695 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-2434fc8e-54d4-4e9d-9fa9-b8efd19502a5 req-3ec8b319-19f2-4fa3-8c45-8704442e3866 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:22.706037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-2434fc8e-54d4-4e9d-9fa9-b8efd19502a5 req-3ec8b319-19f2-4fa3-8c45-8704442e3866 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:22.724808 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-2434fc8e-54d4-4e9d-9fa9-b8efd19502a5 req-3ec8b319-19f2-4fa3-8c45-8704442e3866 service nova] Creating event network-changed:ff5e6ab7-ec2b-46dd-b050-f4b9bceff071 for instance a270d6db-218c-4081-81b9-b161dc70a7bb on hv-cinder-85220 Aug 05 20:47:22.730827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-2434fc8e-54d4-4e9d-9fa9-b8efd19502a5 req-3ec8b319-19f2-4fa3-8c45-8704442e3866 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053925 Aug 05 20:47:22.731434 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 264/490] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:22.756372 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3c9d23dd-dc65-47a8-8529-9cd1e08b7fea tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:22.757888 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3c9d23dd-dc65-47a8-8529-9cd1e08b7fea tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:22.768612 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3c9d23dd-dc65-47a8-8529-9cd1e08b7fea tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:22.770521 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3c9d23dd-dc65-47a8-8529-9cd1e08b7fea tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:22.771153 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3c9d23dd-dc65-47a8-8529-9cd1e08b7fea tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:22.772104 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3c9d23dd-dc65-47a8-8529-9cd1e08b7fea tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:22.772722 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3c9d23dd-dc65-47a8-8529-9cd1e08b7fea tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:22.773152 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3c9d23dd-dc65-47a8-8529-9cd1e08b7fea tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:22.936085 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-98bd2e42-f1a1-4a2f-acd7-e5cc377c7028 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:22.949332 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-98bd2e42-f1a1-4a2f-acd7-e5cc377c7028 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1643 microversion: 2.1 time: 0.282025 Aug 05 20:47:22.950085 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 227/491] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:22 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1643 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:22.955928 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-063415eb-c9aa-44bf-b640-cb3b33f30ed8 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:22.956808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-063415eb-c9aa-44bf-b640-cb3b33f30ed8 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:22.963190 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-063415eb-c9aa-44bf-b640-cb3b33f30ed8 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:22.963849 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-063415eb-c9aa-44bf-b640-cb3b33f30ed8 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:22.964378 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-063415eb-c9aa-44bf-b640-cb3b33f30ed8 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:22.965494 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-063415eb-c9aa-44bf-b640-cb3b33f30ed8 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:22.966198 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-063415eb-c9aa-44bf-b640-cb3b33f30ed8 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:22.966972 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-063415eb-c9aa-44bf-b640-cb3b33f30ed8 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:23.092178 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3c9d23dd-dc65-47a8-8529-9cd1e08b7fea tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:23.103886 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3c9d23dd-dc65-47a8-8529-9cd1e08b7fea tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.352574 Aug 05 20:47:23.114494 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 265/492] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:22 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:23.124035 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-41b3997c-109e-4b01-8982-425028056d00 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:23.126662 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-41b3997c-109e-4b01-8982-425028056d00 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:23.136345 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-41b3997c-109e-4b01-8982-425028056d00 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:23.137444 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-41b3997c-109e-4b01-8982-425028056d00 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:23.138549 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-41b3997c-109e-4b01-8982-425028056d00 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:23.139460 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-41b3997c-109e-4b01-8982-425028056d00 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:23.140224 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-41b3997c-109e-4b01-8982-425028056d00 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:23.140909 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-41b3997c-109e-4b01-8982-425028056d00 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:23.168141 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-063415eb-c9aa-44bf-b640-cb3b33f30ed8 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:23.177690 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-063415eb-c9aa-44bf-b640-cb3b33f30ed8 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:23.179587 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-063415eb-c9aa-44bf-b640-cb3b33f30ed8 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:23.181952 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-063415eb-c9aa-44bf-b640-cb3b33f30ed8 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1811 microversion: 2.20 time: 0.230098 Aug 05 20:47:23.182525 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 228/493] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:22 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1811 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:23.352153 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-41b3997c-109e-4b01-8982-425028056d00 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:23.355464 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:23.363599 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-41b3997c-109e-4b01-8982-425028056d00 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1318 microversion: 2.1 time: 0.247598 Aug 05 20:47:23.364181 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 266/494] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:23 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:24.125915 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-19fc4ced-0d38-4d6f-944d-e4fe5feb69f3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:24.126762 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-19fc4ced-0d38-4d6f-944d-e4fe5feb69f3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:24.136806 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-19fc4ced-0d38-4d6f-944d-e4fe5feb69f3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:24.137211 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-19fc4ced-0d38-4d6f-944d-e4fe5feb69f3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:24.137667 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-19fc4ced-0d38-4d6f-944d-e4fe5feb69f3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:24.138376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-19fc4ced-0d38-4d6f-944d-e4fe5feb69f3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:24.138835 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-19fc4ced-0d38-4d6f-944d-e4fe5feb69f3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:24.139263 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-19fc4ced-0d38-4d6f-944d-e4fe5feb69f3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:24.205291 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-64e45c45-85e1-466b-9372-ca293afba054 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:24.205959 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-64e45c45-85e1-466b-9372-ca293afba054 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:24.214254 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-64e45c45-85e1-466b-9372-ca293afba054 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:24.214572 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-64e45c45-85e1-466b-9372-ca293afba054 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:24.215025 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-64e45c45-85e1-466b-9372-ca293afba054 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:24.215797 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-64e45c45-85e1-466b-9372-ca293afba054 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:24.216262 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-64e45c45-85e1-466b-9372-ca293afba054 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:24.216690 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-64e45c45-85e1-466b-9372-ca293afba054 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:24.390008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-19fc4ced-0d38-4d6f-944d-e4fe5feb69f3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:24.399536 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-19fc4ced-0d38-4d6f-944d-e4fe5feb69f3 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.277663 Aug 05 20:47:24.400495 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 229/495] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:24 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:24.405961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a1db5fae-5896-4379-87f8-9a0ec1861ed9 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:24.406669 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a1db5fae-5896-4379-87f8-9a0ec1861ed9 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:24.413657 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a1db5fae-5896-4379-87f8-9a0ec1861ed9 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:24.414119 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a1db5fae-5896-4379-87f8-9a0ec1861ed9 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:24.414711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a1db5fae-5896-4379-87f8-9a0ec1861ed9 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:24.415809 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a1db5fae-5896-4379-87f8-9a0ec1861ed9 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:24.416397 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a1db5fae-5896-4379-87f8-9a0ec1861ed9 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:24.416992 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a1db5fae-5896-4379-87f8-9a0ec1861ed9 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:24.449983 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-64e45c45-85e1-466b-9372-ca293afba054 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:24.459940 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-64e45c45-85e1-466b-9372-ca293afba054 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:24.461607 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-64e45c45-85e1-466b-9372-ca293afba054 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:24.462881 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-64e45c45-85e1-466b-9372-ca293afba054 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1798 microversion: 2.20 time: 0.261743 Aug 05 20:47:24.463468 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 267/496] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:47:24 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1798 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:47:24.638933 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a1db5fae-5896-4379-87f8-9a0ec1861ed9 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:24.646771 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a1db5fae-5896-4379-87f8-9a0ec1861ed9 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1318 microversion: 2.1 time: 0.244864 Aug 05 20:47:24.647262 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 230/497] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:24 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:25.426920 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-06f29241-6609-4a83-8fb0-e92f57ac66a2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:25.427618 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-06f29241-6609-4a83-8fb0-e92f57ac66a2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:25.434357 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-06f29241-6609-4a83-8fb0-e92f57ac66a2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:25.434843 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-06f29241-6609-4a83-8fb0-e92f57ac66a2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:25.435279 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-06f29241-6609-4a83-8fb0-e92f57ac66a2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:25.436009 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-06f29241-6609-4a83-8fb0-e92f57ac66a2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:25.436463 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-06f29241-6609-4a83-8fb0-e92f57ac66a2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:25.436888 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-06f29241-6609-4a83-8fb0-e92f57ac66a2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:25.577900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-06f29241-6609-4a83-8fb0-e92f57ac66a2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:25.586231 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-06f29241-6609-4a83-8fb0-e92f57ac66a2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.164488 Aug 05 20:47:25.586772 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 268/498] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:25 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:25.671889 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c67dd283-98c3-4eb8-9468-100a3eab54e8 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:25.672892 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c67dd283-98c3-4eb8-9468-100a3eab54e8 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:25.684104 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c67dd283-98c3-4eb8-9468-100a3eab54e8 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:25.684810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c67dd283-98c3-4eb8-9468-100a3eab54e8 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:25.685530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c67dd283-98c3-4eb8-9468-100a3eab54e8 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:25.686671 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c67dd283-98c3-4eb8-9468-100a3eab54e8 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:25.687420 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c67dd283-98c3-4eb8-9468-100a3eab54e8 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:25.688163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c67dd283-98c3-4eb8-9468-100a3eab54e8 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:25.831524 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c67dd283-98c3-4eb8-9468-100a3eab54e8 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:25.842570 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c67dd283-98c3-4eb8-9468-100a3eab54e8 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1468 microversion: 2.1 time: 0.177329 Aug 05 20:47:25.843331 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 231/499] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:25 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1468 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:25.888780 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-17ab2853-bb3f-45c2-bc2a-665c6f7d856c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:25.889275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-17ab2853-bb3f-45c2-bc2a-665c6f7d856c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:25.896300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-17ab2853-bb3f-45c2-bc2a-665c6f7d856c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:25.896944 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-17ab2853-bb3f-45c2-bc2a-665c6f7d856c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:25.897579 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-17ab2853-bb3f-45c2-bc2a-665c6f7d856c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:25.898600 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-17ab2853-bb3f-45c2-bc2a-665c6f7d856c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:25.899250 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-17ab2853-bb3f-45c2-bc2a-665c6f7d856c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:25.899926 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-17ab2853-bb3f-45c2-bc2a-665c6f7d856c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:25.929330 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-17ab2853-bb3f-45c2-bc2a-665c6f7d856c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:47:26.011671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-17ab2853-bb3f-45c2-bc2a-665c6f7d856c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "DELETE /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 204 len: 0 microversion: 2.1 time: 0.126901 Aug 05 20:47:26.012240 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 269/500] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:47:25 2022] DELETE /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:47:26.020592 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8958fc0a-da34-4e69-a22b-60ba936daa17 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:26.021212 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8958fc0a-da34-4e69-a22b-60ba936daa17 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:26.033973 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8958fc0a-da34-4e69-a22b-60ba936daa17 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:26.034565 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8958fc0a-da34-4e69-a22b-60ba936daa17 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:26.035003 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8958fc0a-da34-4e69-a22b-60ba936daa17 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:26.036003 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8958fc0a-da34-4e69-a22b-60ba936daa17 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:26.036466 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8958fc0a-da34-4e69-a22b-60ba936daa17 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:26.036880 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8958fc0a-da34-4e69-a22b-60ba936daa17 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:26.176380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8958fc0a-da34-4e69-a22b-60ba936daa17 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:26.184016 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8958fc0a-da34-4e69-a22b-60ba936daa17 tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1474 microversion: 2.1 time: 0.167325 Aug 05 20:47:26.184549 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 232/501] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:26 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1474 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:26.611537 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6d8c3c80-d39c-421b-ba81-dc81b2e5f63f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:26.612646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6d8c3c80-d39c-421b-ba81-dc81b2e5f63f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:26.622919 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d8c3c80-d39c-421b-ba81-dc81b2e5f63f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:26.623729 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d8c3c80-d39c-421b-ba81-dc81b2e5f63f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:26.624381 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d8c3c80-d39c-421b-ba81-dc81b2e5f63f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:26.625413 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d8c3c80-d39c-421b-ba81-dc81b2e5f63f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:26.626135 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d8c3c80-d39c-421b-ba81-dc81b2e5f63f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:26.626797 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d8c3c80-d39c-421b-ba81-dc81b2e5f63f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:26.783001 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6d8c3c80-d39c-421b-ba81-dc81b2e5f63f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:26.791217 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6d8c3c80-d39c-421b-ba81-dc81b2e5f63f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.186199 Aug 05 20:47:26.791915 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 270/502] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:26 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:27.208859 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-cd0345f8-3784-4b2e-87ba-4b6de09b474c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:27.209959 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-cd0345f8-3784-4b2e-87ba-4b6de09b474c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:27.220276 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd0345f8-3784-4b2e-87ba-4b6de09b474c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:27.221028 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd0345f8-3784-4b2e-87ba-4b6de09b474c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:27.221700 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd0345f8-3784-4b2e-87ba-4b6de09b474c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:27.222614 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd0345f8-3784-4b2e-87ba-4b6de09b474c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:27.223074 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd0345f8-3784-4b2e-87ba-4b6de09b474c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:27.223531 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd0345f8-3784-4b2e-87ba-4b6de09b474c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:27.369167 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-cd0345f8-3784-4b2e-87ba-4b6de09b474c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:27.376828 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-cd0345f8-3784-4b2e-87ba-4b6de09b474c tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1474 microversion: 2.1 time: 0.174021 Aug 05 20:47:27.377382 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 233/503] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:27 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1474 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:27.818356 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cedee6f5-391b-4750-86bd-847e031e032a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:27.819277 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cedee6f5-391b-4750-86bd-847e031e032a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:27.830090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cedee6f5-391b-4750-86bd-847e031e032a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:27.830878 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cedee6f5-391b-4750-86bd-847e031e032a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:27.831767 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cedee6f5-391b-4750-86bd-847e031e032a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:27.832668 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cedee6f5-391b-4750-86bd-847e031e032a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:27.833125 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cedee6f5-391b-4750-86bd-847e031e032a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:27.833548 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cedee6f5-391b-4750-86bd-847e031e032a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:27.976638 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cedee6f5-391b-4750-86bd-847e031e032a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:27.984551 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cedee6f5-391b-4750-86bd-847e031e032a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.173033 Aug 05 20:47:27.985088 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 271/504] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:27 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:28.398444 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-439463ee-536a-45b9-a84f-a69b02e4542a tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:28.399008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-439463ee-536a-45b9-a84f-a69b02e4542a tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:28.406152 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-439463ee-536a-45b9-a84f-a69b02e4542a tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:28.406712 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-439463ee-536a-45b9-a84f-a69b02e4542a tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:28.407298 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-439463ee-536a-45b9-a84f-a69b02e4542a tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:28.408083 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-439463ee-536a-45b9-a84f-a69b02e4542a tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:28.408634 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-439463ee-536a-45b9-a84f-a69b02e4542a tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:28.409046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-439463ee-536a-45b9-a84f-a69b02e4542a tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:28.539879 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-439463ee-536a-45b9-a84f-a69b02e4542a tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:28.548251 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-439463ee-536a-45b9-a84f-a69b02e4542a tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1474 microversion: 2.1 time: 0.153804 Aug 05 20:47:28.548818 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 234/505] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:28 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1474 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:29.006132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ce7b687b-7c86-4b49-88ab-5c5823bf703d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:29.006929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ce7b687b-7c86-4b49-88ab-5c5823bf703d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:29.013585 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce7b687b-7c86-4b49-88ab-5c5823bf703d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:29.014075 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce7b687b-7c86-4b49-88ab-5c5823bf703d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:29.014504 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce7b687b-7c86-4b49-88ab-5c5823bf703d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:29.015204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce7b687b-7c86-4b49-88ab-5c5823bf703d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:29.015678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce7b687b-7c86-4b49-88ab-5c5823bf703d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:29.016101 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce7b687b-7c86-4b49-88ab-5c5823bf703d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:29.244211 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-f3b8929b-fa06-41eb-982b-70e5ffa0a076 req-81546708-dd84-405c-9280-fcc0d1176dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c4191a-faac-40d1-856c-fb7de0c5306f", "name": "network-vif-deleted", "tag": "384a9c0c-aebc-4a88-a701-c99655bee7c7"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:29.249264 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ce7b687b-7c86-4b49-88ab-5c5823bf703d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:29.257739 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ce7b687b-7c86-4b49-88ab-5c5823bf703d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.255632 Aug 05 20:47:29.258564 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 272/506] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:29 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:29.261701 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-f3b8929b-fa06-41eb-982b-70e5ffa0a076 req-81546708-dd84-405c-9280-fcc0d1176dc0 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:29.262183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-f3b8929b-fa06-41eb-982b-70e5ffa0a076 req-81546708-dd84-405c-9280-fcc0d1176dc0 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:29.262611 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-f3b8929b-fa06-41eb-982b-70e5ffa0a076 req-81546708-dd84-405c-9280-fcc0d1176dc0 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:29.274580 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-f3b8929b-fa06-41eb-982b-70e5ffa0a076 req-81546708-dd84-405c-9280-fcc0d1176dc0 service nova] Creating event network-vif-deleted:384a9c0c-aebc-4a88-a701-c99655bee7c7 for instance 75c4191a-faac-40d1-856c-fb7de0c5306f on hv-cinder-85220 Aug 05 20:47:29.280223 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-f3b8929b-fa06-41eb-982b-70e5ffa0a076 req-81546708-dd84-405c-9280-fcc0d1176dc0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039960 Aug 05 20:47:29.281004 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 235/507] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:29.570984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-97e4f68b-ad5f-47b7-826b-fbbd1aa0aefb tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:29.571530 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-97e4f68b-ad5f-47b7-826b-fbbd1aa0aefb tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:29.577899 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97e4f68b-ad5f-47b7-826b-fbbd1aa0aefb tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:29.578386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97e4f68b-ad5f-47b7-826b-fbbd1aa0aefb tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:29.578819 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97e4f68b-ad5f-47b7-826b-fbbd1aa0aefb tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:29.579590 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97e4f68b-ad5f-47b7-826b-fbbd1aa0aefb tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:29.580083 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97e4f68b-ad5f-47b7-826b-fbbd1aa0aefb tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:29.580601 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97e4f68b-ad5f-47b7-826b-fbbd1aa0aefb tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:29.613098 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97e4f68b-ad5f-47b7-826b-fbbd1aa0aefb tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:29.613572 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97e4f68b-ad5f-47b7-826b-fbbd1aa0aefb tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:29.614009 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-97e4f68b-ad5f-47b7-826b-fbbd1aa0aefb tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:29.614514 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-97e4f68b-ad5f-47b7-826b-fbbd1aa0aefb tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lazy-loading 'fault' on Instance uuid 75c4191a-faac-40d1-856c-fb7de0c5306f {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:47:29.667440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-97e4f68b-ad5f-47b7-826b-fbbd1aa0aefb tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6728c782d82146648c1b1de46866476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aae2e3faf47484886a5ccc86424b5c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:29.675414 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-97e4f68b-ad5f-47b7-826b-fbbd1aa0aefb tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 200 len: 1308 microversion: 2.1 time: 0.108573 Aug 05 20:47:29.676250 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 273/508] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:29 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:30.284511 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-36832c6a-532e-40c4-98a9-05441faaaf1c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:30.285615 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-36832c6a-532e-40c4-98a9-05441faaaf1c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:30.292279 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36832c6a-532e-40c4-98a9-05441faaaf1c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:30.292747 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36832c6a-532e-40c4-98a9-05441faaaf1c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:30.293181 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36832c6a-532e-40c4-98a9-05441faaaf1c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:30.293878 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36832c6a-532e-40c4-98a9-05441faaaf1c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:30.294334 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36832c6a-532e-40c4-98a9-05441faaaf1c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:30.294757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36832c6a-532e-40c4-98a9-05441faaaf1c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:30.436930 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-36832c6a-532e-40c4-98a9-05441faaaf1c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:30.445261 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-36832c6a-532e-40c4-98a9-05441faaaf1c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1506 microversion: 2.1 time: 0.168814 Aug 05 20:47:30.445820 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 236/509] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:30 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:30.466350 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7684b5b7-50ee-4a23-a22d-e4579ab346c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2003cc88-152f-4896-a335-5acefdae2abc"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:30.468895 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7684b5b7-50ee-4a23-a22d-e4579ab346c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:30.478630 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7684b5b7-50ee-4a23-a22d-e4579ab346c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:30.479110 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7684b5b7-50ee-4a23-a22d-e4579ab346c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:30.479592 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7684b5b7-50ee-4a23-a22d-e4579ab346c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:30.480274 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7684b5b7-50ee-4a23-a22d-e4579ab346c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:30.480730 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7684b5b7-50ee-4a23-a22d-e4579ab346c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:30.481151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7684b5b7-50ee-4a23-a22d-e4579ab346c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:30.504399 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-7684b5b7-50ee-4a23-a22d-e4579ab346c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] HTTP exception thrown: Cannot 'attach_volume' instance 601febf0-78f3-4519-b08f-382dad6f8839 while it is in vm_state rescued Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7684b5b7-50ee-4a23-a22d-e4579ab346c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Request method failure captured: Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: POST /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839/os-volume_attachments HTTP/1.1 Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 74 Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YF2IfsRUiZL8M7nD-mEoyeG9Rq0E23WMw4I16wHL0z90_rs5iFP7YW1fsRcWUvL-Vthi6uNykTnQoJHrrltziloH00ABGq52tY5SvfKLfx_4LqwaAb5lb3uNmD6zXxhShPue3pn6u4DtQuST4mvgSVDuYoAY6Cg1vyAFtoIP0Z3_Jc Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 80b5e8457f2d47b7a7c0d2856a513b77 Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:47:30.506073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:47:30.507603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_80b5e8457f2d47b7a7c0d2856a513b77", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:47:30.507603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:47:30.507603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 80b5e8457f2d47b7a7c0d2856a513b77 Aug 05 20:47:30.507603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:47:30.507603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-ServerRescueNegativeTestJSON-566068597-project Aug 05 20:47:30.507603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:47:30.507603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:47:30.507603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 2a09fb7dd7ec47e5b37d533c3701a3a2 Aug 05 20:47:30.507603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-566068597-project Aug 05 20:47:30.507603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Aug 05 20:47:30.507603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {"volumeAttachment": {"volumeId": "2003cc88-152f-4896-a335-5acefdae2abc"}} Aug 05 20:47:30.507603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Cannot 'attach_volume' instance 601febf0-78f3-4519-b08f-382dad6f8839 while it is in vm_state rescued Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'server_id': '601febf0-78f3-4519-b08f-382dad6f8839', 'body': {'volumeAttachment': {'volumeId': '2003cc88-152f-4896-a335-5acefdae2abc'}}} Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 601febf0-78f3-4519-b08f-382dad6f8839 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:47:30.508339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 601febf0-78f3-4519-b08f-382dad6f8839 while it is in vm_state rescued Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:47:30.509711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:47:30.511026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:47:30.511026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:47:30.511026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 601febf0-78f3-4519-b08f-382dad6f8839 while it is in vm_state rescued Aug 05 20:47:30.511026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:30.511026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7684b5b7-50ee-4a23-a22d-e4579ab346c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Returning 409 to user: Cannot 'attach_volume' instance 601febf0-78f3-4519-b08f-382dad6f8839 while it is in vm_state rescued {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:47:30.511026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7684b5b7-50ee-4a23-a22d-e4579ab346c5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "POST /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045300 Aug 05 20:47:30.511026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 274/510] 10.222.0.100 () {60 vars in 1328 bytes} [Fri Aug 5 20:47:30 2022] POST /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 05 20:47:30.517155 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-aaa95bdd-d426-411d-a9c6-98b8a0e1f100 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:30.517714 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-aaa95bdd-d426-411d-a9c6-98b8a0e1f100 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:30.524670 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aaa95bdd-d426-411d-a9c6-98b8a0e1f100 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:30.525157 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aaa95bdd-d426-411d-a9c6-98b8a0e1f100 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:30.525589 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aaa95bdd-d426-411d-a9c6-98b8a0e1f100 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:30.526278 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aaa95bdd-d426-411d-a9c6-98b8a0e1f100 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:30.526751 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aaa95bdd-d426-411d-a9c6-98b8a0e1f100 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:30.527148 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aaa95bdd-d426-411d-a9c6-98b8a0e1f100 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:30.578338 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:30.604815 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-aaa95bdd-d426-411d-a9c6-98b8a0e1f100 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "POST /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839/action" status: 202 len: 0 microversion: 2.1 time: 0.091203 Aug 05 20:47:30.609168 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 237/511] 10.222.0.100 () {60 vars in 1283 bytes} [Fri Aug 5 20:47:30 2022] POST /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:47:30.614706 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3f9151cf-f0cc-4192-bd75-b31b6b406f2b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:30.615784 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3f9151cf-f0cc-4192-bd75-b31b6b406f2b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:30.622805 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f9151cf-f0cc-4192-bd75-b31b6b406f2b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:30.623852 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f9151cf-f0cc-4192-bd75-b31b6b406f2b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:30.624403 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f9151cf-f0cc-4192-bd75-b31b6b406f2b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:30.625239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f9151cf-f0cc-4192-bd75-b31b6b406f2b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:30.625930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f9151cf-f0cc-4192-bd75-b31b6b406f2b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:30.626737 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f9151cf-f0cc-4192-bd75-b31b6b406f2b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:30.701065 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9639a6ee-7132-480e-bc4c-953c5c2e513f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:30.701774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9639a6ee-7132-480e-bc4c-953c5c2e513f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] [instance: 75c4191a-faac-40d1-856c-fb7de0c5306f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:30.708768 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9639a6ee-7132-480e-bc4c-953c5c2e513f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:30.709289 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9639a6ee-7132-480e-bc4c-953c5c2e513f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:30.709738 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9639a6ee-7132-480e-bc4c-953c5c2e513f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:30.711121 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9639a6ee-7132-480e-bc4c-953c5c2e513f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:30.711704 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9639a6ee-7132-480e-bc4c-953c5c2e513f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:30.712199 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9639a6ee-7132-480e-bc4c-953c5c2e513f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:30.726514 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-9639a6ee-7132-480e-bc4c-953c5c2e513f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] HTTP exception thrown: Instance 75c4191a-faac-40d1-856c-fb7de0c5306f could not be found. Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9639a6ee-7132-480e-bc4c-953c5c2e513f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Request method failure captured: Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f HTTP/1.1 Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YHLBn-NVc7KeDPQ3_3rtdLkLfkQm2cp6o8C7zUTO0hn9lezsiWIlZN_TulZvlz4bJ5jzHbiQzvgGjtxCTXexoh26tTPBwQPtiAb-fWHh9rSzgHSrp4Zs6woYy3jUvYslxnimkVgv5t7SfHW6UA4iJIkgsh3XD1XvImCbre5pT6t1GQ Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 0aae2e3faf47484886a5ccc86424b5c9 Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-VolumesNegativeTest-2143104489 Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:47:30.728221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:47:30.729584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0aae2e3faf47484886a5ccc86424b5c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/0aae2e3faf47484886a5ccc86424b5c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/0aae2e3faf47484886a5ccc86424b5c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_0aae2e3faf47484886a5ccc86424b5c9", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:47:30.729584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-VolumesNegativeTest-2143104489 Aug 05 20:47:30.729584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 0aae2e3faf47484886a5ccc86424b5c9 Aug 05 20:47:30.729584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-VolumesNegativeTest-2143104489 Aug 05 20:47:30.729584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-VolumesNegativeTest-2143104489-project Aug 05 20:47:30.729584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:47:30.729584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:47:30.729584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 6728c782d82146648c1b1de46866476d Aug 05 20:47:30.729584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-VolumesNegativeTest-2143104489-project Aug 05 20:47:30.729584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:47:30.729584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 75c4191a-faac-40d1-856c-fb7de0c5306f could not be found. Aug 05 20:47:30.729584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '75c4191a-faac-40d1-856c-fb7de0c5306f'} Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c4191a-faac-40d1-856c-fb7de0c5306f could not be found. Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:47:30.730364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c4191a-faac-40d1-856c-fb7de0c5306f could not be found. Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c4191a-faac-40d1-856c-fb7de0c5306f could not be found. Aug 05 20:47:30.731882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:47:30.733171 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9639a6ee-7132-480e-bc4c-953c5c2e513f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] Returning 404 to user: Instance 75c4191a-faac-40d1-856c-fb7de0c5306f could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:47:30.733171 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9639a6ee-7132-480e-bc4c-953c5c2e513f tempest-VolumesNegativeTest-2143104489 tempest-VolumesNegativeTest-2143104489-project] 10.222.0.100 "GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f" status: 404 len: 111 microversion: 2.1 time: 0.032880 Aug 05 20:47:30.733171 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 238/512] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:30 2022] GET /compute/v2.1/servers/75c4191a-faac-40d1-856c-fb7de0c5306f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:47:30.853662 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3f9151cf-f0cc-4192-bd75-b31b6b406f2b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:30.862439 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3f9151cf-f0cc-4192-bd75-b31b6b406f2b tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1514 microversion: 2.1 time: 0.251932 Aug 05 20:47:30.863273 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 275/513] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:30 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:31.885029 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0c0912e0-23b8-47fc-b21a-42fc055fadd8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:31.885718 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0c0912e0-23b8-47fc-b21a-42fc055fadd8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:31.892621 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0c0912e0-23b8-47fc-b21a-42fc055fadd8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:31.893123 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0c0912e0-23b8-47fc-b21a-42fc055fadd8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:31.893867 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0c0912e0-23b8-47fc-b21a-42fc055fadd8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:31.894496 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0c0912e0-23b8-47fc-b21a-42fc055fadd8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:31.894972 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0c0912e0-23b8-47fc-b21a-42fc055fadd8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:31.895422 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0c0912e0-23b8-47fc-b21a-42fc055fadd8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:32.050489 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0c0912e0-23b8-47fc-b21a-42fc055fadd8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:32.058965 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0c0912e0-23b8-47fc-b21a-42fc055fadd8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1514 microversion: 2.1 time: 0.177958 Aug 05 20:47:32.059845 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 239/514] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:31 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:33.084018 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-be76284e-2de4-4384-8b6c-a32962131c21 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:33.084640 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-be76284e-2de4-4384-8b6c-a32962131c21 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:33.091281 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be76284e-2de4-4384-8b6c-a32962131c21 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:33.091809 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be76284e-2de4-4384-8b6c-a32962131c21 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:33.092243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be76284e-2de4-4384-8b6c-a32962131c21 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:33.092937 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be76284e-2de4-4384-8b6c-a32962131c21 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:33.093382 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be76284e-2de4-4384-8b6c-a32962131c21 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:33.093800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-be76284e-2de4-4384-8b6c-a32962131c21 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:33.232988 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-be76284e-2de4-4384-8b6c-a32962131c21 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:33.242753 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-be76284e-2de4-4384-8b6c-a32962131c21 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1514 microversion: 2.1 time: 0.164931 Aug 05 20:47:33.243393 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 276/515] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:33 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:34.267710 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-02536b11-1e78-4420-af77-9671e45483b2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:34.268623 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-02536b11-1e78-4420-af77-9671e45483b2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:34.276332 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-02536b11-1e78-4420-af77-9671e45483b2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:34.276823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-02536b11-1e78-4420-af77-9671e45483b2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:34.277266 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-02536b11-1e78-4420-af77-9671e45483b2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:34.277971 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-02536b11-1e78-4420-af77-9671e45483b2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:34.278423 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-02536b11-1e78-4420-af77-9671e45483b2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:34.278857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-02536b11-1e78-4420-af77-9671e45483b2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:34.415655 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-02536b11-1e78-4420-af77-9671e45483b2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:34.423514 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-02536b11-1e78-4420-af77-9671e45483b2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1520 microversion: 2.1 time: 0.161833 Aug 05 20:47:34.424110 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 240/516] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:34 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:35.808307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-08ab6f85-1705-4d3c-837e-ffc98a7f8641 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Action: 'create', calling method: .version_select at 0x7f9be77f7ca0>, body: {"keypair": {"name": "tempest-keypair-86409659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5VtSbI+L7P1ZipYMWO66AgWG3xgc5Y/ud6FFC12vDUvbpNI0HfGG55ZpnEEL+km9heWmh/TSEH/q1PyuNobAthB8Z0Y1QrtLzYRES9LUWp1LF02661WGmh8e5opJRYqg=="}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:35.825276 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-08ab6f85-1705-4d3c-837e-ffc98a7f8641 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Getting quotas for project 80b5e8457f2d47b7a7c0d2856a513b77. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:47:35.829116 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-08ab6f85-1705-4d3c-837e-ffc98a7f8641 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Getting quotas for user 2a09fb7dd7ec47e5b37d533c3701a3a2 and project 80b5e8457f2d47b7a7c0d2856a513b77. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:47:35.852409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-08ab6f85-1705-4d3c-837e-ffc98a7f8641 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.047988 Aug 05 20:47:35.853107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 277/517] 10.222.0.100 () {60 vars in 1164 bytes} [Fri Aug 5 20:47:35 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:37.466982 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1950180689", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d3a56079-e01c-4484-8c24-d71366de1fc5"}], "security_groups": [{"name": "tempest-securitygroup--1252627369"}], "key_name": "tempest-keypair-86409659", "user_data": "}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:37.477194 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:37.617078 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.network.neutron [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] validate_networks() for [('d3a56079-e01c-4484-8c24-d71366de1fc5', None, None, None, None, None)] {{(pid=124431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:47:38.067505 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Flavor limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:47:38.067929 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Image limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:47:38.068633 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Flavor pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:47:38.069044 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Image pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:47:38.069460 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:47:38.078376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:38.079091 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:38.079572 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:38.080314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:38.080767 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:38.081419 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:38.100177 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Getting quotas for project 80b5e8457f2d47b7a7c0d2856a513b77. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:47:38.104541 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Getting quotas for user 2a09fb7dd7ec47e5b37d533c3701a3a2 and project 80b5e8457f2d47b7a7c0d2856a513b77. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:47:38.117071 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Going to run 1 instances... {{(pid=124431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:47:38.119522 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:47:38.169103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9d8932e5-24ea-4b65-b709-960930ee45d0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 0.706522 Aug 05 20:47:38.170243 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 241/518] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:47:37 2022] POST /compute/v2.1/servers => generated 411 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:47:38.182764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5d18f94a-d763-453a-a075-fd22ee6c18ca tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:38.183405 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5d18f94a-d763-453a-a075-fd22ee6c18ca tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:38.253840 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5d18f94a-d763-453a-a075-fd22ee6c18ca tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:38.263048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5d18f94a-d763-453a-a075-fd22ee6c18ca tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1248 microversion: 2.1 time: 0.085074 Aug 05 20:47:38.264032 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 278/519] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:38 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:38.920125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8723e02b-795f-493f-a4d8-589bedb2f530 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:38.920882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8723e02b-795f-493f-a4d8-589bedb2f530 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:38.937136 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8723e02b-795f-493f-a4d8-589bedb2f530 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:38.938076 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8723e02b-795f-493f-a4d8-589bedb2f530 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:38.938684 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8723e02b-795f-493f-a4d8-589bedb2f530 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:38.939779 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8723e02b-795f-493f-a4d8-589bedb2f530 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:38.940983 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8723e02b-795f-493f-a4d8-589bedb2f530 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:38.941574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8723e02b-795f-493f-a4d8-589bedb2f530 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:38.980542 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8723e02b-795f-493f-a4d8-589bedb2f530 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947/ips" status: 200 len: 149 microversion: 2.1 time: 0.066122 Aug 05 20:47:38.985109 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 242/520] 10.222.0.100 () {58 vars in 1253 bytes} [Fri Aug 5 20:47:38 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947/ips => generated 149 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:38.997638 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-74ae6eaf-6dd3-498b-9ba7-a01610758558 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26c1f759-8368-4127-87d1-1e5485757362"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:39.000162 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-74ae6eaf-6dd3-498b-9ba7-a01610758558 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:39.012449 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74ae6eaf-6dd3-498b-9ba7-a01610758558 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:39.013251 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74ae6eaf-6dd3-498b-9ba7-a01610758558 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:39.013919 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74ae6eaf-6dd3-498b-9ba7-a01610758558 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:39.014800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74ae6eaf-6dd3-498b-9ba7-a01610758558 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:39.015442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74ae6eaf-6dd3-498b-9ba7-a01610758558 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:39.016021 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-74ae6eaf-6dd3-498b-9ba7-a01610758558 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:39.139115 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-74ae6eaf-6dd3-498b-9ba7-a01610758558 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] HTTP exception thrown: Invalid volume: volume 26c1f759-8368-4127-87d1-1e5485757362 is already attached to instances: c086ce48-8e37-432f-ab19-e87c53936473 Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-74ae6eaf-6dd3-498b-9ba7-a01610758558 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Request method failure captured: Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: POST /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947/os-volume_attachments HTTP/1.1 Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 74 Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEVT2RIo0sOYhrqEh_HYIhCXXgNEIU5O2TrKSb8O78pPQouV0XDBbsdQswVZsYX73wXTNNa6pCEJklCAufLFYW63yx7CPEVZ0Ry2Y0Ikjromqqlux7d4-wF_GlTFyol_iESoMY4-E-LXutqB0V3ogXtBOvhKaWzWfUtI3jvN-kS_PY Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:47:39.141132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:47:39.142435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8b67138a484f481099c562d7e3ca8401", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:47:39.142435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:47:39.142435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:47:39.142435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:47:39.142435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:47:39.142435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:47:39.142435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:47:39.142435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 8e1baad75342476aa0c64bda0414e334 Aug 05 20:47:39.142435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:47:39.142435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Aug 05 20:47:39.142435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {"volumeAttachment": {"volumeId": "26c1f759-8368-4127-87d1-1e5485757362"}} Aug 05 20:47:39.142435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Invalid volume: volume 26c1f759-8368-4127-87d1-1e5485757362 is already attached to instances: c086ce48-8e37-432f-ab19-e87c53936473 Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'server_id': '784e7d44-0869-48e1-84f5-e35567f73947', 'body': {'volumeAttachment': {'volumeId': '26c1f759-8368-4127-87d1-1e5485757362'}}} Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 26c1f759-8368-4127-87d1-1e5485757362 is already attached to instances: c086ce48-8e37-432f-ab19-e87c53936473 Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:39.143182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 26c1f759-8368-4127-87d1-1e5485757362 is already attached to instances: c086ce48-8e37-432f-ab19-e87c53936473 Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:39.144375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:47:39.145667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:47:39.145667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:47:39.145667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:47:39.145667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 26c1f759-8368-4127-87d1-1e5485757362 is already attached to instances: c086ce48-8e37-432f-ab19-e87c53936473 Aug 05 20:47:39.145667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:39.147603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-74ae6eaf-6dd3-498b-9ba7-a01610758558 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Returning 400 to user: Invalid volume: volume 26c1f759-8368-4127-87d1-1e5485757362 is already attached to instances: c086ce48-8e37-432f-ab19-e87c53936473 {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:47:39.148713 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-74ae6eaf-6dd3-498b-9ba7-a01610758558 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "POST /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.155403 Aug 05 20:47:39.149663 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 279/521] 10.222.0.100 () {60 vars in 1328 bytes} [Fri Aug 5 20:47:38 2022] POST /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947/os-volume_attachments => generated 174 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:47:39.160096 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f60a5311-f4e5-45b5-9fd4-e9618c489d06 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:39.161243 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f60a5311-f4e5-45b5-9fd4-e9618c489d06 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:39.171061 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f60a5311-f4e5-45b5-9fd4-e9618c489d06 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:39.175654 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f60a5311-f4e5-45b5-9fd4-e9618c489d06 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:39.176535 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f60a5311-f4e5-45b5-9fd4-e9618c489d06 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:39.178938 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f60a5311-f4e5-45b5-9fd4-e9618c489d06 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:39.179651 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f60a5311-f4e5-45b5-9fd4-e9618c489d06 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:39.180330 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f60a5311-f4e5-45b5-9fd4-e9618c489d06 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:39.217504 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f60a5311-f4e5-45b5-9fd4-e9618c489d06 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Going to try to terminate instance {{(pid=124431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:47:39.287771 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-12b49c05-66f3-4587-80a8-dab02ef7ddbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:39.288438 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-12b49c05-66f3-4587-80a8-dab02ef7ddbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:39.296915 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-12b49c05-66f3-4587-80a8-dab02ef7ddbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:39.297429 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-12b49c05-66f3-4587-80a8-dab02ef7ddbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:39.297875 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-12b49c05-66f3-4587-80a8-dab02ef7ddbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:39.298590 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-12b49c05-66f3-4587-80a8-dab02ef7ddbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:39.299046 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-12b49c05-66f3-4587-80a8-dab02ef7ddbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:39.299512 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-12b49c05-66f3-4587-80a8-dab02ef7ddbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:39.351646 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f60a5311-f4e5-45b5-9fd4-e9618c489d06 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 204 len: 0 microversion: 2.1 time: 0.196049 Aug 05 20:47:39.352431 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 243/522] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:47:39 2022] DELETE /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:47:39.359928 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ee0f0890-4fac-4408-beb7-2ee818451fdd tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:39.362489 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ee0f0890-4fac-4408-beb7-2ee818451fdd tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:39.371293 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ee0f0890-4fac-4408-beb7-2ee818451fdd tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:39.372325 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ee0f0890-4fac-4408-beb7-2ee818451fdd tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:39.372973 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ee0f0890-4fac-4408-beb7-2ee818451fdd tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:39.374032 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ee0f0890-4fac-4408-beb7-2ee818451fdd tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:39.375384 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ee0f0890-4fac-4408-beb7-2ee818451fdd tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:39.376001 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ee0f0890-4fac-4408-beb7-2ee818451fdd tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:39.419556 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-12b49c05-66f3-4587-80a8-dab02ef7ddbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:39.430772 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-12b49c05-66f3-4587-80a8-dab02ef7ddbd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1300 microversion: 2.1 time: 0.148729 Aug 05 20:47:39.431805 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 280/523] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:39 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1300 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:39.449644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-accc5da3-9708-428e-9c71-af9bbb31e5a6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:39.450897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-accc5da3-9708-428e-9c71-af9bbb31e5a6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:39.462776 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-accc5da3-9708-428e-9c71-af9bbb31e5a6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:39.464094 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-accc5da3-9708-428e-9c71-af9bbb31e5a6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:39.465788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-accc5da3-9708-428e-9c71-af9bbb31e5a6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:39.467829 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-accc5da3-9708-428e-9c71-af9bbb31e5a6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:39.468788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-accc5da3-9708-428e-9c71-af9bbb31e5a6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:39.469404 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-accc5da3-9708-428e-9c71-af9bbb31e5a6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:39.543447 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-ee0f0890-4fac-4408-beb7-2ee818451fdd tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lazy-loading 'services' on Instance uuid 39afe8dc-01f2-4947-b48c-ac9664fb46cd {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:47:39.769439 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ee0f0890-4fac-4408-beb7-2ee818451fdd tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "DELETE /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/os-volume_attachments/cc31259b-9650-4e67-b671-bcf61140ee22" status: 202 len: 0 microversion: 2.1 time: 0.415017 Aug 05 20:47:39.770138 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 244/524] 10.222.0.100 () {58 vars in 1421 bytes} [Fri Aug 5 20:47:39 2022] DELETE /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/os-volume_attachments/cc31259b-9650-4e67-b671-bcf61140ee22 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:47:39.845927 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-accc5da3-9708-428e-9c71-af9bbb31e5a6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:39.856123 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-accc5da3-9708-428e-9c71-af9bbb31e5a6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1685 microversion: 2.1 time: 0.422970 Aug 05 20:47:39.856937 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 281/525] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:39 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1685 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:40.455561 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0059fa23-0617-49d5-a0ab-faccd0858aaf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:40.456276 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0059fa23-0617-49d5-a0ab-faccd0858aaf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:40.464987 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0059fa23-0617-49d5-a0ab-faccd0858aaf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:40.466509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0059fa23-0617-49d5-a0ab-faccd0858aaf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:40.467164 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0059fa23-0617-49d5-a0ab-faccd0858aaf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:40.468011 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0059fa23-0617-49d5-a0ab-faccd0858aaf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:40.468464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0059fa23-0617-49d5-a0ab-faccd0858aaf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:40.468880 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0059fa23-0617-49d5-a0ab-faccd0858aaf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:40.667112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0059fa23-0617-49d5-a0ab-faccd0858aaf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:40.674733 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0059fa23-0617-49d5-a0ab-faccd0858aaf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1308 microversion: 2.1 time: 0.225085 Aug 05 20:47:40.676180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 245/526] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:40 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:40.880122 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-68dbf03b-463e-4174-ae3b-4d9a0fb3001a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:40.881705 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-68dbf03b-463e-4174-ae3b-4d9a0fb3001a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:40.895239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-68dbf03b-463e-4174-ae3b-4d9a0fb3001a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:40.896003 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-68dbf03b-463e-4174-ae3b-4d9a0fb3001a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:40.896547 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-68dbf03b-463e-4174-ae3b-4d9a0fb3001a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:40.897935 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-68dbf03b-463e-4174-ae3b-4d9a0fb3001a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:40.898644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-68dbf03b-463e-4174-ae3b-4d9a0fb3001a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:40.899190 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-68dbf03b-463e-4174-ae3b-4d9a0fb3001a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:41.153688 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-68dbf03b-463e-4174-ae3b-4d9a0fb3001a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:41.166541 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-68dbf03b-463e-4174-ae3b-4d9a0fb3001a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1685 microversion: 2.1 time: 0.290912 Aug 05 20:47:41.182904 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 282/527] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:40 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1685 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:41.697993 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-cb00ce6f-d61a-4a84-bfd2-ef00a7137061 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:41.699310 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-cb00ce6f-d61a-4a84-bfd2-ef00a7137061 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:41.706396 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cb00ce6f-d61a-4a84-bfd2-ef00a7137061 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:41.707264 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cb00ce6f-d61a-4a84-bfd2-ef00a7137061 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:41.707958 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cb00ce6f-d61a-4a84-bfd2-ef00a7137061 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:41.708773 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cb00ce6f-d61a-4a84-bfd2-ef00a7137061 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:41.709341 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cb00ce6f-d61a-4a84-bfd2-ef00a7137061 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:41.710144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cb00ce6f-d61a-4a84-bfd2-ef00a7137061 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:41.828240 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-cb00ce6f-d61a-4a84-bfd2-ef00a7137061 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:41.838694 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-cb00ce6f-d61a-4a84-bfd2-ef00a7137061 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1306 microversion: 2.1 time: 0.145212 Aug 05 20:47:41.848718 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 246/528] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:41 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1306 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:42.191852 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-95d58140-0345-4867-b357-33d9d4bdf561 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:42.192511 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-95d58140-0345-4867-b357-33d9d4bdf561 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:42.219583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95d58140-0345-4867-b357-33d9d4bdf561 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:42.220355 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95d58140-0345-4867-b357-33d9d4bdf561 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:42.221015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95d58140-0345-4867-b357-33d9d4bdf561 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:42.221965 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95d58140-0345-4867-b357-33d9d4bdf561 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:42.222570 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95d58140-0345-4867-b357-33d9d4bdf561 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:42.223753 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95d58140-0345-4867-b357-33d9d4bdf561 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:42.556106 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-95d58140-0345-4867-b357-33d9d4bdf561 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:42.558856 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:42.569341 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-95d58140-0345-4867-b357-33d9d4bdf561 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1685 microversion: 2.1 time: 0.382830 Aug 05 20:47:42.570479 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 283/529] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:42 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1685 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:42.864392 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f37bff62-068c-47a8-8f75-d04ac1625453 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:42.865914 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f37bff62-068c-47a8-8f75-d04ac1625453 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:42.878406 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f37bff62-068c-47a8-8f75-d04ac1625453 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:42.879173 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f37bff62-068c-47a8-8f75-d04ac1625453 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:42.880228 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f37bff62-068c-47a8-8f75-d04ac1625453 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:42.881197 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f37bff62-068c-47a8-8f75-d04ac1625453 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:42.882209 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f37bff62-068c-47a8-8f75-d04ac1625453 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:42.882803 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f37bff62-068c-47a8-8f75-d04ac1625453 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:43.144443 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e3326858-aead-4c80-b1a7-595568a7b54e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:43.160251 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e3326858-aead-4c80-b1a7-595568a7b54e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:43.161075 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e3326858-aead-4c80-b1a7-595568a7b54e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:43.161685 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e3326858-aead-4c80-b1a7-595568a7b54e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:43.225078 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e3326858-aead-4c80-b1a7-595568a7b54e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Going to try to stop instance {{(pid=124432) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 20:47:43.310148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e3326858-aead-4c80-b1a7-595568a7b54e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "POST /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/action" status: 202 len: 0 microversion: 2.1 time: 0.167600 Aug 05 20:47:43.312263 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 284/530] 10.222.0.100 () {60 vars in 1283 bytes} [Fri Aug 5 20:47:43 2022] POST /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:47:43.343016 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d86543ce-69a3-43ee-be3d-01afe6f67960 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:43.348562 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d86543ce-69a3-43ee-be3d-01afe6f67960 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:43.363181 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d86543ce-69a3-43ee-be3d-01afe6f67960 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:43.368283 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d86543ce-69a3-43ee-be3d-01afe6f67960 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:43.369107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d86543ce-69a3-43ee-be3d-01afe6f67960 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:43.371266 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d86543ce-69a3-43ee-be3d-01afe6f67960 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:43.372378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d86543ce-69a3-43ee-be3d-01afe6f67960 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:43.372994 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d86543ce-69a3-43ee-be3d-01afe6f67960 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:43.495169 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f37bff62-068c-47a8-8f75-d04ac1625453 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:43.507280 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f37bff62-068c-47a8-8f75-d04ac1625453 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1374 microversion: 2.1 time: 0.650893 Aug 05 20:47:43.508583 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 247/531] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:42 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1374 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:43.525762 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-941a4f3f-6993-4c9b-bbd8-5e1bd701226e req-ba78e2c9-bb91-47d0-b09c-e4e737c155b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784e7d44-0869-48e1-84f5-e35567f73947", "name": "network-vif-deleted", "tag": "71f59c3d-04cf-4aa9-981a-c0db0c85c972"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:43.539155 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-941a4f3f-6993-4c9b-bbd8-5e1bd701226e req-ba78e2c9-bb91-47d0-b09c-e4e737c155b7 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:43.540838 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-941a4f3f-6993-4c9b-bbd8-5e1bd701226e req-ba78e2c9-bb91-47d0-b09c-e4e737c155b7 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:43.541605 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-941a4f3f-6993-4c9b-bbd8-5e1bd701226e req-ba78e2c9-bb91-47d0-b09c-e4e737c155b7 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:43.558347 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-941a4f3f-6993-4c9b-bbd8-5e1bd701226e req-ba78e2c9-bb91-47d0-b09c-e4e737c155b7 service nova] Creating event network-vif-deleted:71f59c3d-04cf-4aa9-981a-c0db0c85c972 for instance 784e7d44-0869-48e1-84f5-e35567f73947 on hv-cinder-85220 Aug 05 20:47:43.567004 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-941a4f3f-6993-4c9b-bbd8-5e1bd701226e req-ba78e2c9-bb91-47d0-b09c-e4e737c155b7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056683 Aug 05 20:47:43.568012 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 248/532] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:43.633740 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c208a593-9170-4e27-99a6-f69f3e37fa9f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:43.634449 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c208a593-9170-4e27-99a6-f69f3e37fa9f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:43.648622 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c208a593-9170-4e27-99a6-f69f3e37fa9f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:43.649125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c208a593-9170-4e27-99a6-f69f3e37fa9f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:43.649551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c208a593-9170-4e27-99a6-f69f3e37fa9f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:43.652898 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c208a593-9170-4e27-99a6-f69f3e37fa9f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:43.653384 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c208a593-9170-4e27-99a6-f69f3e37fa9f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:43.654267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c208a593-9170-4e27-99a6-f69f3e37fa9f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:43.891568 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c208a593-9170-4e27-99a6-f69f3e37fa9f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:43.900698 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c208a593-9170-4e27-99a6-f69f3e37fa9f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 200 len: 1330 microversion: 2.1 time: 0.289908 Aug 05 20:47:43.915829 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 249/533] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:43 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 1330 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:43.930629 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d86543ce-69a3-43ee-be3d-01afe6f67960 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:43.939748 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d86543ce-69a3-43ee-be3d-01afe6f67960 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1680 microversion: 2.1 time: 0.612083 Aug 05 20:47:43.953474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 285/534] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:43 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1680 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:44.530662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9c5665f8-55b1-43d5-aaaf-1e3953115540 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:44.531276 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9c5665f8-55b1-43d5-aaaf-1e3953115540 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:44.538346 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c5665f8-55b1-43d5-aaaf-1e3953115540 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:44.539068 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c5665f8-55b1-43d5-aaaf-1e3953115540 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:44.545069 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c5665f8-55b1-43d5-aaaf-1e3953115540 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:44.551526 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c5665f8-55b1-43d5-aaaf-1e3953115540 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:44.552251 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c5665f8-55b1-43d5-aaaf-1e3953115540 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:44.552849 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c5665f8-55b1-43d5-aaaf-1e3953115540 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:44.923334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-06edad72-9929-4fdd-b008-71ae3b58860c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:44.925549 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-06edad72-9929-4fdd-b008-71ae3b58860c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:44.942246 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-06edad72-9929-4fdd-b008-71ae3b58860c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:44.942734 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-06edad72-9929-4fdd-b008-71ae3b58860c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:44.948944 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-06edad72-9929-4fdd-b008-71ae3b58860c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:44.950071 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-06edad72-9929-4fdd-b008-71ae3b58860c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:44.951622 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-06edad72-9929-4fdd-b008-71ae3b58860c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:44.952490 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-06edad72-9929-4fdd-b008-71ae3b58860c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:44.981364 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-06edad72-9929-4fdd-b008-71ae3b58860c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] HTTP exception thrown: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-06edad72-9929-4fdd-b008-71ae3b58860c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Request method failure captured: Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 HTTP/1.1 Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEVT2RIo0sOYhrqEh_HYIhCXXgNEIU5O2TrKSb8O78pPQouV0XDBbsdQswVZsYX73wXTNNa6pCEJklCAufLFYW63yx7CPEVZ0Ry2Y0Ikjromqqlux7d4-wF_GlTFyol_iESoMY4-E-LXutqB0V3ogXtBOvhKaWzWfUtI3jvN-kS_PY Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:47:44.983286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:47:44.984884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8b67138a484f481099c562d7e3ca8401", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:47:44.984884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:47:44.984884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:47:44.984884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:47:44.984884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:47:44.984884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:47:44.984884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:47:44.984884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 8e1baad75342476aa0c64bda0414e334 Aug 05 20:47:44.984884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:47:44.984884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:47:44.984884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:47:44.984884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '784e7d44-0869-48e1-84f5-e35567f73947'} Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:47:44.985703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:47:44.986978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:44.990286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-06edad72-9929-4fdd-b008-71ae3b58860c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Returning 404 to user: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:47:44.991316 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-06edad72-9929-4fdd-b008-71ae3b58860c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 404 len: 111 microversion: 2.1 time: 0.072474 Aug 05 20:47:44.992082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 286/535] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:44 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:47:45.002014 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-86894acc-8082-44f4-8580-426c8ab66638 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:45.002911 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-86894acc-8082-44f4-8580-426c8ab66638 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:45.017078 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-86894acc-8082-44f4-8580-426c8ab66638 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:45.020138 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-86894acc-8082-44f4-8580-426c8ab66638 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:45.025735 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-86894acc-8082-44f4-8580-426c8ab66638 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:45.026755 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-86894acc-8082-44f4-8580-426c8ab66638 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:45.026879 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-9c5665f8-55b1-43d5-aaaf-1e3953115540 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:45.027880 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-86894acc-8082-44f4-8580-426c8ab66638 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:45.028480 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-86894acc-8082-44f4-8580-426c8ab66638 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:45.039041 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9c5665f8-55b1-43d5-aaaf-1e3953115540 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1374 microversion: 2.1 time: 0.509995 Aug 05 20:47:45.055599 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 250/536] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:44 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1374 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:45.066166 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-568b1ded-0b4d-492d-946a-fe5365110fd6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '.version_select at 0x7f9bec352280>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:45.116950 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-568b1ded-0b4d-492d-946a-fe5365110fd6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122232371" status: 202 len: 0 microversion: 2.1 time: 0.054736 Aug 05 20:47:45.118122 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 251/537] 10.222.0.100 () {58 vars in 1226 bytes} [Fri Aug 5 20:47:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122232371 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:47:45.402084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-86894acc-8082-44f4-8580-426c8ab66638 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:45.424574 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-86894acc-8082-44f4-8580-426c8ab66638 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1680 microversion: 2.1 time: 0.425394 Aug 05 20:47:45.426625 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 287/538] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:44 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1680 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:46.026771 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-5644add5-82fa-4a3f-bf67-c1685bcaab77 req-99fb6ebc-e302-4e1f-9521-bc3586867aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34d5df9-1498-4fdd-a688-5d8bad899a6f", "tag": "eaa0d3a0-5e0f-465f-ac62-8d0749b1809c"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:46.047052 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-5644add5-82fa-4a3f-bf67-c1685bcaab77 req-99fb6ebc-e302-4e1f-9521-bc3586867aa9 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:46.051160 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-5644add5-82fa-4a3f-bf67-c1685bcaab77 req-99fb6ebc-e302-4e1f-9521-bc3586867aa9 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:46.080677 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3a2b33a5-729e-4c78-b175-988bfa5f76f5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:46.080677 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3a2b33a5-729e-4c78-b175-988bfa5f76f5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:46.081228 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-5644add5-82fa-4a3f-bf67-c1685bcaab77 req-99fb6ebc-e302-4e1f-9521-bc3586867aa9 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:46.089767 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3a2b33a5-729e-4c78-b175-988bfa5f76f5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:46.090930 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3a2b33a5-729e-4c78-b175-988bfa5f76f5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:46.091591 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3a2b33a5-729e-4c78-b175-988bfa5f76f5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:46.093132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3a2b33a5-729e-4c78-b175-988bfa5f76f5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:46.094192 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3a2b33a5-729e-4c78-b175-988bfa5f76f5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:46.095405 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3a2b33a5-729e-4c78-b175-988bfa5f76f5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:46.101797 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-5644add5-82fa-4a3f-bf67-c1685bcaab77 req-99fb6ebc-e302-4e1f-9521-bc3586867aa9 service nova] Creating event network-changed:eaa0d3a0-5e0f-465f-ac62-8d0749b1809c for instance c34d5df9-1498-4fdd-a688-5d8bad899a6f on hv-cinder-85220 Aug 05 20:47:46.112510 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-5644add5-82fa-4a3f-bf67-c1685bcaab77 req-99fb6ebc-e302-4e1f-9521-bc3586867aa9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088803 Aug 05 20:47:46.113482 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 252/539] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:47:46.132522 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-76b65f13-aaf2-40c9-bf13-db56a264c5c1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:46.133508 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-76b65f13-aaf2-40c9-bf13-db56a264c5c1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:46.141398 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-76b65f13-aaf2-40c9-bf13-db56a264c5c1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:46.142087 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-76b65f13-aaf2-40c9-bf13-db56a264c5c1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:46.142701 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-76b65f13-aaf2-40c9-bf13-db56a264c5c1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:46.143762 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-76b65f13-aaf2-40c9-bf13-db56a264c5c1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:46.144716 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-76b65f13-aaf2-40c9-bf13-db56a264c5c1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:46.146413 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-76b65f13-aaf2-40c9-bf13-db56a264c5c1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:46.251496 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-76b65f13-aaf2-40c9-bf13-db56a264c5c1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lazy-loading 'services' on Instance uuid c086ce48-8e37-432f-ab19-e87c53936473 {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:47:46.364638 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-76b65f13-aaf2-40c9-bf13-db56a264c5c1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/os-volume_attachments/26c1f759-8368-4127-87d1-1e5485757362" status: 202 len: 0 microversion: 2.1 time: 0.247393 Aug 05 20:47:46.366410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 253/540] 10.222.0.100 () {58 vars in 1421 bytes} [Fri Aug 5 20:47:46 2022] DELETE /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/os-volume_attachments/26c1f759-8368-4127-87d1-1e5485757362 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:47:46.385172 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3442c08c-4872-448f-bdf9-d1d3c8771c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:46.393052 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3442c08c-4872-448f-bdf9-d1d3c8771c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:46.401363 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3442c08c-4872-448f-bdf9-d1d3c8771c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:46.402142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3442c08c-4872-448f-bdf9-d1d3c8771c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:46.402738 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3442c08c-4872-448f-bdf9-d1d3c8771c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:46.403655 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3442c08c-4872-448f-bdf9-d1d3c8771c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:46.404473 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3442c08c-4872-448f-bdf9-d1d3c8771c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:46.404903 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3442c08c-4872-448f-bdf9-d1d3c8771c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:46.461778 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3442c08c-4872-448f-bdf9-d1d3c8771c50 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090654 Aug 05 20:47:46.462808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 254/541] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:47:46 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:46.487890 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-64b7e86a-aa7b-41b5-ba03-b7b0b44c439b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:46.490642 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-64b7e86a-aa7b-41b5-ba03-b7b0b44c439b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:46.512044 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-64b7e86a-aa7b-41b5-ba03-b7b0b44c439b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:46.512810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-64b7e86a-aa7b-41b5-ba03-b7b0b44c439b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:46.514629 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-64b7e86a-aa7b-41b5-ba03-b7b0b44c439b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:46.515567 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-64b7e86a-aa7b-41b5-ba03-b7b0b44c439b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:46.516240 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-64b7e86a-aa7b-41b5-ba03-b7b0b44c439b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:46.516801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-64b7e86a-aa7b-41b5-ba03-b7b0b44c439b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:46.522379 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:46.641953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3a2b33a5-729e-4c78-b175-988bfa5f76f5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:46.652733 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3a2b33a5-729e-4c78-b175-988bfa5f76f5 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1374 microversion: 2.1 time: 0.595306 Aug 05 20:47:46.671669 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 288/542] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:46 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1374 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:46.840098 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-64b7e86a-aa7b-41b5-ba03-b7b0b44c439b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:46.853990 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-64b7e86a-aa7b-41b5-ba03-b7b0b44c439b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1680 microversion: 2.1 time: 0.389591 Aug 05 20:47:46.873361 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 255/543] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:46 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1680 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:47.476578 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c3580b1f-ac86-4b6c-817c-2b79d7659dae tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:47.480530 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c3580b1f-ac86-4b6c-817c-2b79d7659dae tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:47.488035 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:47.489995 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c3580b1f-ac86-4b6c-817c-2b79d7659dae tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:47.490525 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c3580b1f-ac86-4b6c-817c-2b79d7659dae tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:47.490990 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c3580b1f-ac86-4b6c-817c-2b79d7659dae tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:47.491724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c3580b1f-ac86-4b6c-817c-2b79d7659dae tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:47.492172 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c3580b1f-ac86-4b6c-817c-2b79d7659dae tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:47.492591 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c3580b1f-ac86-4b6c-817c-2b79d7659dae tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:47.543466 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c3580b1f-ac86-4b6c-817c-2b79d7659dae tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073051 Aug 05 20:47:47.548290 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 289/544] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:47:47 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:47.679826 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f4f45844-0c75-40b7-a3a1-78073715a0bf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:47.681000 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f4f45844-0c75-40b7-a3a1-78073715a0bf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:47.688199 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4f45844-0c75-40b7-a3a1-78073715a0bf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:47.688881 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4f45844-0c75-40b7-a3a1-78073715a0bf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:47.689475 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4f45844-0c75-40b7-a3a1-78073715a0bf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:47.690376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4f45844-0c75-40b7-a3a1-78073715a0bf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:47.691015 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4f45844-0c75-40b7-a3a1-78073715a0bf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:47.692081 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f4f45844-0c75-40b7-a3a1-78073715a0bf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:47.854601 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f4f45844-0c75-40b7-a3a1-78073715a0bf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:47.862253 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f4f45844-0c75-40b7-a3a1-78073715a0bf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1374 microversion: 2.1 time: 0.186657 Aug 05 20:47:47.862999 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 256/545] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:47 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:47.882323 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7e945e47-461a-4e1d-97f0-4e3d27c142cf tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:47.883945 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7e945e47-461a-4e1d-97f0-4e3d27c142cf tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:47.890492 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7e945e47-461a-4e1d-97f0-4e3d27c142cf tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:47.891187 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7e945e47-461a-4e1d-97f0-4e3d27c142cf tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:47.891799 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7e945e47-461a-4e1d-97f0-4e3d27c142cf tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:47.892578 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7e945e47-461a-4e1d-97f0-4e3d27c142cf tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:47.893264 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7e945e47-461a-4e1d-97f0-4e3d27c142cf tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:47.894068 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7e945e47-461a-4e1d-97f0-4e3d27c142cf tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:48.046183 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7e945e47-461a-4e1d-97f0-4e3d27c142cf tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:48.055819 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7e945e47-461a-4e1d-97f0-4e3d27c142cf tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1680 microversion: 2.1 time: 0.178487 Aug 05 20:47:48.065518 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 290/546] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:47 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:48.557097 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-6ebfd1d1-4285-4d83-a9e2-c6982feaca87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:48.559656 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-6ebfd1d1-4285-4d83-a9e2-c6982feaca87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:48.561727 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:48.562468 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=6 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:48.569797 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6ebfd1d1-4285-4d83-a9e2-c6982feaca87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:48.570021 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6ebfd1d1-4285-4d83-a9e2-c6982feaca87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:48.570590 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6ebfd1d1-4285-4d83-a9e2-c6982feaca87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:48.571304 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6ebfd1d1-4285-4d83-a9e2-c6982feaca87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:48.571790 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6ebfd1d1-4285-4d83-a9e2-c6982feaca87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:48.572214 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6ebfd1d1-4285-4d83-a9e2-c6982feaca87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:48.606318 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-6ebfd1d1-4285-4d83-a9e2-c6982feaca87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053202 Aug 05 20:47:48.607379 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 257/547] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:47:48 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:48.885286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-469245fe-c716-4a9e-a06d-0881cf72af44 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:48.886500 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-469245fe-c716-4a9e-a06d-0881cf72af44 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:48.889178 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:48.895807 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-469245fe-c716-4a9e-a06d-0881cf72af44 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:48.896586 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-469245fe-c716-4a9e-a06d-0881cf72af44 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:48.897214 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-469245fe-c716-4a9e-a06d-0881cf72af44 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:48.898124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-469245fe-c716-4a9e-a06d-0881cf72af44 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:48.898752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-469245fe-c716-4a9e-a06d-0881cf72af44 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:48.899335 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-469245fe-c716-4a9e-a06d-0881cf72af44 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:49.083272 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-20663ef0-27f3-4832-9a02-360451db2b4e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:49.084001 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-20663ef0-27f3-4832-9a02-360451db2b4e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:49.092022 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20663ef0-27f3-4832-9a02-360451db2b4e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:49.092593 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20663ef0-27f3-4832-9a02-360451db2b4e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:49.093252 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20663ef0-27f3-4832-9a02-360451db2b4e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:49.094372 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20663ef0-27f3-4832-9a02-360451db2b4e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:49.095335 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20663ef0-27f3-4832-9a02-360451db2b4e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:49.095655 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20663ef0-27f3-4832-9a02-360451db2b4e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:49.184785 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-469245fe-c716-4a9e-a06d-0881cf72af44 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:49.196969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-469245fe-c716-4a9e-a06d-0881cf72af44 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1374 microversion: 2.1 time: 0.317761 Aug 05 20:47:49.205355 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 291/548] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:48 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1374 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:49.353443 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-20663ef0-27f3-4832-9a02-360451db2b4e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:49.364296 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-20663ef0-27f3-4832-9a02-360451db2b4e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1680 microversion: 2.1 time: 0.287991 Aug 05 20:47:49.366272 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 258/549] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:49 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1680 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:49.428253 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1c994483-bcb4-495b-9eec-6f078da412a3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Action: 'create', calling method: .version_select at 0x7f9bec1034c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1555072571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItheDFyYLXrCtPGo5CcQ3A5aU0+0uTKk4s+t1rvSvq3NoqrO6Gy0gl8XnNy3pOLK86KWXy1W+jYhz8ulp17ndL5BfurMuJrIOMtnugJKlFsDqizi44aoxLrwbUg3ZA01w=="}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:49.445065 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-1c994483-bcb4-495b-9eec-6f078da412a3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Getting quotas for project c671352d2d2c475ab5c58932b6ecf5bc. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:47:49.449843 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-1c994483-bcb4-495b-9eec-6f078da412a3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Getting quotas for user 9b5ea50e80674c9f96821af04540ba39 and project c671352d2d2c475ab5c58932b6ecf5bc. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:47:49.476231 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1c994483-bcb4-495b-9eec-6f078da412a3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.267810 Aug 05 20:47:49.477434 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 292/550] 10.222.0.100 () {60 vars in 1164 bytes} [Fri Aug 5 20:47:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:49.626102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-066ee685-ef58-427e-817c-85e84016f8e4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:49.628685 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-066ee685-ef58-427e-817c-85e84016f8e4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:49.648737 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-066ee685-ef58-427e-817c-85e84016f8e4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:49.649237 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-066ee685-ef58-427e-817c-85e84016f8e4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:49.649672 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-066ee685-ef58-427e-817c-85e84016f8e4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:49.650378 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-066ee685-ef58-427e-817c-85e84016f8e4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:49.650822 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-066ee685-ef58-427e-817c-85e84016f8e4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:49.651238 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-066ee685-ef58-427e-817c-85e84016f8e4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:49.693428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-066ee685-ef58-427e-817c-85e84016f8e4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078346 Aug 05 20:47:49.694623 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 259/551] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:47:49 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:47:49.819765 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0d003ad5-5b86-4ca3-9620-8f8216d54dca tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:49.822829 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0d003ad5-5b86-4ca3-9620-8f8216d54dca tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:49.831433 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d003ad5-5b86-4ca3-9620-8f8216d54dca tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:49.831966 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d003ad5-5b86-4ca3-9620-8f8216d54dca tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:49.832416 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d003ad5-5b86-4ca3-9620-8f8216d54dca tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:49.833238 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d003ad5-5b86-4ca3-9620-8f8216d54dca tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:49.833655 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d003ad5-5b86-4ca3-9620-8f8216d54dca tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:49.834081 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0d003ad5-5b86-4ca3-9620-8f8216d54dca tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:49.873896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0d003ad5-5b86-4ca3-9620-8f8216d54dca tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:47:49.992742 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0d003ad5-5b86-4ca3-9620-8f8216d54dca tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 204 len: 0 microversion: 2.1 time: 0.190542 Aug 05 20:47:49.995919 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 293/552] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:47:49 2022] DELETE /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:47:50.006895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-880b1bd6-07a2-4b50-83de-ebb444c5bab3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:50.007748 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-880b1bd6-07a2-4b50-83de-ebb444c5bab3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:50.014960 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-880b1bd6-07a2-4b50-83de-ebb444c5bab3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:50.015968 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-880b1bd6-07a2-4b50-83de-ebb444c5bab3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:50.016296 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-880b1bd6-07a2-4b50-83de-ebb444c5bab3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:50.016982 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-880b1bd6-07a2-4b50-83de-ebb444c5bab3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:50.017653 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-880b1bd6-07a2-4b50-83de-ebb444c5bab3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:50.018074 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-880b1bd6-07a2-4b50-83de-ebb444c5bab3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:50.173077 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-880b1bd6-07a2-4b50-83de-ebb444c5bab3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:50.181694 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-880b1bd6-07a2-4b50-83de-ebb444c5bab3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1685 microversion: 2.1 time: 0.181338 Aug 05 20:47:50.182406 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 260/553] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:49 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1685 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:50.227718 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-317b755d-948f-4fe8-ba38-80b9d0a29cb7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:50.230022 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-317b755d-948f-4fe8-ba38-80b9d0a29cb7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:50.246142 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-317b755d-948f-4fe8-ba38-80b9d0a29cb7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:50.246941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-317b755d-948f-4fe8-ba38-80b9d0a29cb7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:50.247623 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-317b755d-948f-4fe8-ba38-80b9d0a29cb7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:50.248666 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-317b755d-948f-4fe8-ba38-80b9d0a29cb7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:50.249327 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-317b755d-948f-4fe8-ba38-80b9d0a29cb7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:50.249757 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-317b755d-948f-4fe8-ba38-80b9d0a29cb7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:50.386244 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-b8997bec-f1fa-4243-8ee8-2cc3f32d3315 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:50.386953 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-b8997bec-f1fa-4243-8ee8-2cc3f32d3315 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:50.398553 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b8997bec-f1fa-4243-8ee8-2cc3f32d3315 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:50.399183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b8997bec-f1fa-4243-8ee8-2cc3f32d3315 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:50.399778 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b8997bec-f1fa-4243-8ee8-2cc3f32d3315 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:50.400509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b8997bec-f1fa-4243-8ee8-2cc3f32d3315 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:50.401049 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b8997bec-f1fa-4243-8ee8-2cc3f32d3315 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:50.401372 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b8997bec-f1fa-4243-8ee8-2cc3f32d3315 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:50.550582 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-317b755d-948f-4fe8-ba38-80b9d0a29cb7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:50.564047 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-317b755d-948f-4fe8-ba38-80b9d0a29cb7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1374 microversion: 2.1 time: 0.341679 Aug 05 20:47:50.565933 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 294/554] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:50 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1374 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:50.633512 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-b8997bec-f1fa-4243-8ee8-2cc3f32d3315 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:50.642342 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-b8997bec-f1fa-4243-8ee8-2cc3f32d3315 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1680 microversion: 2.1 time: 0.260006 Aug 05 20:47:50.643305 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 261/555] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:50 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1680 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:51.202481 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-07aa4dd2-9fce-40da-8e15-3786d3e67c1c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:51.203162 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-07aa4dd2-9fce-40da-8e15-3786d3e67c1c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:51.210301 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07aa4dd2-9fce-40da-8e15-3786d3e67c1c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:51.210820 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07aa4dd2-9fce-40da-8e15-3786d3e67c1c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:51.211254 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07aa4dd2-9fce-40da-8e15-3786d3e67c1c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:51.211984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07aa4dd2-9fce-40da-8e15-3786d3e67c1c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:51.212435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07aa4dd2-9fce-40da-8e15-3786d3e67c1c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:51.212862 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-07aa4dd2-9fce-40da-8e15-3786d3e67c1c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:51.350086 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-07aa4dd2-9fce-40da-8e15-3786d3e67c1c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:51.358754 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-07aa4dd2-9fce-40da-8e15-3786d3e67c1c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1685 microversion: 2.1 time: 0.160294 Aug 05 20:47:51.359523 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 295/556] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:51 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:51.587072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-275ae28f-5231-4e35-b4c0-c07e356b1fd1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:51.587769 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-275ae28f-5231-4e35-b4c0-c07e356b1fd1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:51.594593 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-275ae28f-5231-4e35-b4c0-c07e356b1fd1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:51.595096 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-275ae28f-5231-4e35-b4c0-c07e356b1fd1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:51.595569 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-275ae28f-5231-4e35-b4c0-c07e356b1fd1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:51.596264 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-275ae28f-5231-4e35-b4c0-c07e356b1fd1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:51.596722 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-275ae28f-5231-4e35-b4c0-c07e356b1fd1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:51.597142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-275ae28f-5231-4e35-b4c0-c07e356b1fd1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:51.665727 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3f852985-99b3-4080-a4f2-801d557f7dc2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:51.681348 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3f852985-99b3-4080-a4f2-801d557f7dc2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:51.696790 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f852985-99b3-4080-a4f2-801d557f7dc2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:51.698650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f852985-99b3-4080-a4f2-801d557f7dc2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:51.700651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f852985-99b3-4080-a4f2-801d557f7dc2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:51.702057 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f852985-99b3-4080-a4f2-801d557f7dc2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:51.702588 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f852985-99b3-4080-a4f2-801d557f7dc2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:51.703022 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3f852985-99b3-4080-a4f2-801d557f7dc2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:51.755238 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-275ae28f-5231-4e35-b4c0-c07e356b1fd1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:51.763410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-275ae28f-5231-4e35-b4c0-c07e356b1fd1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1374 microversion: 2.1 time: 0.180579 Aug 05 20:47:51.764158 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 262/557] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:51 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:51.891066 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3f852985-99b3-4080-a4f2-801d557f7dc2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:51.901528 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3f852985-99b3-4080-a4f2-801d557f7dc2 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1680 microversion: 2.1 time: 0.240191 Aug 05 20:47:51.905838 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 296/558] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:51 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1680 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:51.920600 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-9200195d-af35-4330-9ed6-5b255e700b2a req-fc73c2b9-e9d3-4770-9c83-4b03856f98c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34d5df9-1498-4fdd-a688-5d8bad899a6f", "name": "network-vif-plugged", "status": "completed", "tag": "eaa0d3a0-5e0f-465f-ac62-8d0749b1809c"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:51.932439 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-9200195d-af35-4330-9ed6-5b255e700b2a req-fc73c2b9-e9d3-4770-9c83-4b03856f98c7 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:51.933059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-9200195d-af35-4330-9ed6-5b255e700b2a req-fc73c2b9-e9d3-4770-9c83-4b03856f98c7 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:51.933754 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-9200195d-af35-4330-9ed6-5b255e700b2a req-fc73c2b9-e9d3-4770-9c83-4b03856f98c7 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:51.950403 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-9200195d-af35-4330-9ed6-5b255e700b2a req-fc73c2b9-e9d3-4770-9c83-4b03856f98c7 service nova] Creating event network-vif-plugged:eaa0d3a0-5e0f-465f-ac62-8d0749b1809c for instance c34d5df9-1498-4fdd-a688-5d8bad899a6f on hv-cinder-85220 Aug 05 20:47:51.955820 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-9200195d-af35-4330-9ed6-5b255e700b2a req-fc73c2b9-e9d3-4770-9c83-4b03856f98c7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039199 Aug 05 20:47:51.957095 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 263/559] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:52.381152 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4656afcc-e83c-4aa8-8b21-e5a3ebe124f5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:52.382489 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4656afcc-e83c-4aa8-8b21-e5a3ebe124f5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:52.390344 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4656afcc-e83c-4aa8-8b21-e5a3ebe124f5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:52.391213 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4656afcc-e83c-4aa8-8b21-e5a3ebe124f5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:52.391892 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4656afcc-e83c-4aa8-8b21-e5a3ebe124f5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:52.392820 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4656afcc-e83c-4aa8-8b21-e5a3ebe124f5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:52.393520 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4656afcc-e83c-4aa8-8b21-e5a3ebe124f5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:52.394035 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4656afcc-e83c-4aa8-8b21-e5a3ebe124f5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:52.634405 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4656afcc-e83c-4aa8-8b21-e5a3ebe124f5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:52.643047 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4656afcc-e83c-4aa8-8b21-e5a3ebe124f5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1685 microversion: 2.1 time: 0.266723 Aug 05 20:47:52.658327 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 297/560] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:52 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1685 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:52.787460 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-91e17a22-e08a-48c9-b819-b69c3922870a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:52.788410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-91e17a22-e08a-48c9-b819-b69c3922870a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:52.796759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91e17a22-e08a-48c9-b819-b69c3922870a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:52.797295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91e17a22-e08a-48c9-b819-b69c3922870a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:52.797688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91e17a22-e08a-48c9-b819-b69c3922870a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:52.798950 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91e17a22-e08a-48c9-b819-b69c3922870a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:52.799614 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91e17a22-e08a-48c9-b819-b69c3922870a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:52.799881 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91e17a22-e08a-48c9-b819-b69c3922870a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:52.930947 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a993c366-5b29-431f-a3df-b288333d9b82 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:52.931928 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a993c366-5b29-431f-a3df-b288333d9b82 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:52.941363 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a993c366-5b29-431f-a3df-b288333d9b82 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:52.942525 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a993c366-5b29-431f-a3df-b288333d9b82 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:52.943223 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a993c366-5b29-431f-a3df-b288333d9b82 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:52.945340 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a993c366-5b29-431f-a3df-b288333d9b82 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:52.945340 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a993c366-5b29-431f-a3df-b288333d9b82 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:52.945340 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a993c366-5b29-431f-a3df-b288333d9b82 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:53.047393 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-91e17a22-e08a-48c9-b819-b69c3922870a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:53.057314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-91e17a22-e08a-48c9-b819-b69c3922870a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1374 microversion: 2.1 time: 0.274583 Aug 05 20:47:53.058675 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 264/561] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:52 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1374 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:53.165878 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a993c366-5b29-431f-a3df-b288333d9b82 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:53.174505 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a993c366-5b29-431f-a3df-b288333d9b82 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1680 microversion: 2.1 time: 0.248114 Aug 05 20:47:53.175302 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 298/562] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:52 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1680 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:53.506040 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-cef07fe2-7818-4b19-8f36-2e4f7b4fc54d req-13c7832f-14bb-4939-bbe9-03d18c05b8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c086ce48-8e37-432f-ab19-e87c53936473", "name": "network-vif-deleted", "tag": "f6caac16-d258-4d36-8bff-99bcad0b9419"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:53.536240 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-cef07fe2-7818-4b19-8f36-2e4f7b4fc54d req-13c7832f-14bb-4939-bbe9-03d18c05b8e2 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:53.536542 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-cef07fe2-7818-4b19-8f36-2e4f7b4fc54d req-13c7832f-14bb-4939-bbe9-03d18c05b8e2 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:53.536967 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-cef07fe2-7818-4b19-8f36-2e4f7b4fc54d req-13c7832f-14bb-4939-bbe9-03d18c05b8e2 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:53.556641 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-cef07fe2-7818-4b19-8f36-2e4f7b4fc54d req-13c7832f-14bb-4939-bbe9-03d18c05b8e2 service nova] Creating event network-vif-deleted:f6caac16-d258-4d36-8bff-99bcad0b9419 for instance c086ce48-8e37-432f-ab19-e87c53936473 on hv-cinder-85220 Aug 05 20:47:53.562982 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-cef07fe2-7818-4b19-8f36-2e4f7b4fc54d req-13c7832f-14bb-4939-bbe9-03d18c05b8e2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062426 Aug 05 20:47:53.567573 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 265/563] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:53.678620 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-03ffb6d3-4328-4205-a177-e76a6c0306f0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:53.679924 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-03ffb6d3-4328-4205-a177-e76a6c0306f0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:53.691488 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03ffb6d3-4328-4205-a177-e76a6c0306f0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:53.692152 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03ffb6d3-4328-4205-a177-e76a6c0306f0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:53.692786 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03ffb6d3-4328-4205-a177-e76a6c0306f0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:53.693532 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03ffb6d3-4328-4205-a177-e76a6c0306f0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:53.694063 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03ffb6d3-4328-4205-a177-e76a6c0306f0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:53.694556 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-03ffb6d3-4328-4205-a177-e76a6c0306f0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:53.741416 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:53.824467 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-03ffb6d3-4328-4205-a177-e76a6c0306f0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:53.834791 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-03ffb6d3-4328-4205-a177-e76a6c0306f0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1331 microversion: 2.1 time: 0.164152 Aug 05 20:47:53.848470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 299/564] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:53 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1331 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:54.079103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-35166696-f689-4496-a0c5-c27ab7afe37a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:54.079928 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-35166696-f689-4496-a0c5-c27ab7afe37a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:54.092410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-35166696-f689-4496-a0c5-c27ab7afe37a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:54.093194 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-35166696-f689-4496-a0c5-c27ab7afe37a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:54.093803 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-35166696-f689-4496-a0c5-c27ab7afe37a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:54.094507 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-35166696-f689-4496-a0c5-c27ab7afe37a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:54.094952 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-35166696-f689-4496-a0c5-c27ab7afe37a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:54.095388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-35166696-f689-4496-a0c5-c27ab7afe37a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:54.197960 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ae6cd908-3422-44d4-9158-e990c589d737 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:54.199802 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ae6cd908-3422-44d4-9158-e990c589d737 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:54.215456 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ae6cd908-3422-44d4-9158-e990c589d737 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:54.215999 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ae6cd908-3422-44d4-9158-e990c589d737 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:54.216440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ae6cd908-3422-44d4-9158-e990c589d737 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:54.217169 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ae6cd908-3422-44d4-9158-e990c589d737 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:54.217617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ae6cd908-3422-44d4-9158-e990c589d737 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:54.218040 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ae6cd908-3422-44d4-9158-e990c589d737 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:54.259100 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-35166696-f689-4496-a0c5-c27ab7afe37a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:54.268243 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-35166696-f689-4496-a0c5-c27ab7afe37a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1374 microversion: 2.1 time: 0.193233 Aug 05 20:47:54.269193 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 266/565] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:54 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:54.424623 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ae6cd908-3422-44d4-9158-e990c589d737 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:54.433927 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ae6cd908-3422-44d4-9158-e990c589d737 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1680 microversion: 2.1 time: 0.241292 Aug 05 20:47:54.434832 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 300/566] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:54 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:54.857562 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4ceb0f06-1c28-427c-a8cc-83e4af6fe5a9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:54.858174 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4ceb0f06-1c28-427c-a8cc-83e4af6fe5a9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:54.864602 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ceb0f06-1c28-427c-a8cc-83e4af6fe5a9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:54.865067 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ceb0f06-1c28-427c-a8cc-83e4af6fe5a9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:54.865496 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ceb0f06-1c28-427c-a8cc-83e4af6fe5a9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:54.866196 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ceb0f06-1c28-427c-a8cc-83e4af6fe5a9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:54.866635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ceb0f06-1c28-427c-a8cc-83e4af6fe5a9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:54.867051 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ceb0f06-1c28-427c-a8cc-83e4af6fe5a9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:54.901376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ceb0f06-1c28-427c-a8cc-83e4af6fe5a9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:54.901871 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ceb0f06-1c28-427c-a8cc-83e4af6fe5a9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:54.902288 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ceb0f06-1c28-427c-a8cc-83e4af6fe5a9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:54.902745 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-4ceb0f06-1c28-427c-a8cc-83e4af6fe5a9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lazy-loading 'fault' on Instance uuid c086ce48-8e37-432f-ab19-e87c53936473 {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:47:54.952949 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4ceb0f06-1c28-427c-a8cc-83e4af6fe5a9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:54.970880 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4ceb0f06-1c28-427c-a8cc-83e4af6fe5a9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 200 len: 1336 microversion: 2.1 time: 0.117455 Aug 05 20:47:54.972024 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 267/567] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:54 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 1336 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:55.292156 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-73b87400-86fa-41c3-8c2b-0011b3cff594 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:55.292924 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-73b87400-86fa-41c3-8c2b-0011b3cff594 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:55.301988 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73b87400-86fa-41c3-8c2b-0011b3cff594 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:55.302502 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73b87400-86fa-41c3-8c2b-0011b3cff594 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:55.302936 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73b87400-86fa-41c3-8c2b-0011b3cff594 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:55.303832 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73b87400-86fa-41c3-8c2b-0011b3cff594 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:55.304330 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73b87400-86fa-41c3-8c2b-0011b3cff594 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:55.304695 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73b87400-86fa-41c3-8c2b-0011b3cff594 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:55.442714 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-73b87400-86fa-41c3-8c2b-0011b3cff594 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:55.450467 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-73b87400-86fa-41c3-8c2b-0011b3cff594 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1568 microversion: 2.1 time: 0.163174 Aug 05 20:47:55.451300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 301/568] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:55 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:55.456192 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-07b5d7e2-514e-4966-a5a2-f18e5971a6a6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:55.456830 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-07b5d7e2-514e-4966-a5a2-f18e5971a6a6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:55.463543 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-07b5d7e2-514e-4966-a5a2-f18e5971a6a6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:55.464037 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-07b5d7e2-514e-4966-a5a2-f18e5971a6a6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:55.464469 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-07b5d7e2-514e-4966-a5a2-f18e5971a6a6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:55.465167 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-07b5d7e2-514e-4966-a5a2-f18e5971a6a6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:55.465621 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-07b5d7e2-514e-4966-a5a2-f18e5971a6a6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:55.466046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-07b5d7e2-514e-4966-a5a2-f18e5971a6a6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:55.470968 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6177526e-3328-483f-bf13-37efc7f21681 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:55.471489 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6177526e-3328-483f-bf13-37efc7f21681 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:55.478054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6177526e-3328-483f-bf13-37efc7f21681 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:55.478540 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6177526e-3328-483f-bf13-37efc7f21681 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:55.478999 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6177526e-3328-483f-bf13-37efc7f21681 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:55.479723 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6177526e-3328-483f-bf13-37efc7f21681 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:55.480171 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6177526e-3328-483f-bf13-37efc7f21681 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:55.480588 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6177526e-3328-483f-bf13-37efc7f21681 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:55.598490 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6177526e-3328-483f-bf13-37efc7f21681 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131322 Aug 05 20:47:55.599307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 302/569] 10.222.0.100 () {58 vars in 1280 bytes} [Fri Aug 5 20:47:55 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:55.635389 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-07b5d7e2-514e-4966-a5a2-f18e5971a6a6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:55.643922 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-07b5d7e2-514e-4966-a5a2-f18e5971a6a6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1680 microversion: 2.1 time: 0.191434 Aug 05 20:47:55.644456 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 268/570] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:55 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:47:55.993459 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-bbb0837b-a80b-4c87-be9c-28c40b507c57 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:55.994214 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-bbb0837b-a80b-4c87-be9c-28c40b507c57 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:56.000846 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bbb0837b-a80b-4c87-be9c-28c40b507c57 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:56.001423 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bbb0837b-a80b-4c87-be9c-28c40b507c57 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:56.001946 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bbb0837b-a80b-4c87-be9c-28c40b507c57 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:56.002723 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bbb0837b-a80b-4c87-be9c-28c40b507c57 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:56.003180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bbb0837b-a80b-4c87-be9c-28c40b507c57 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:56.003668 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bbb0837b-a80b-4c87-be9c-28c40b507c57 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:56.021887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-bbb0837b-a80b-4c87-be9c-28c40b507c57 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] HTTP exception thrown: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-bbb0837b-a80b-4c87-be9c-28c40b507c57 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Request method failure captured: Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 HTTP/1.1 Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEVT2RIo0sOYhrqEh_HYIhCXXgNEIU5O2TrKSb8O78pPQouV0XDBbsdQswVZsYX73wXTNNa6pCEJklCAufLFYW63yx7CPEVZ0Ry2Y0Ikjromqqlux7d4-wF_GlTFyol_iESoMY4-E-LXutqB0V3ogXtBOvhKaWzWfUtI3jvN-kS_PY Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:47:56.023654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:47:56.025218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8b67138a484f481099c562d7e3ca8401", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:47:56.025218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:47:56.025218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:47:56.025218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:47:56.025218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:47:56.025218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:47:56.025218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:47:56.025218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 8e1baad75342476aa0c64bda0414e334 Aug 05 20:47:56.025218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:47:56.025218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:47:56.025218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:47:56.025218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': 'c086ce48-8e37-432f-ab19-e87c53936473'} Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:47:56.026334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:47:56.027793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:47:56.030394 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-bbb0837b-a80b-4c87-be9c-28c40b507c57 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Returning 404 to user: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:47:56.031262 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-bbb0837b-a80b-4c87-be9c-28c40b507c57 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 404 len: 111 microversion: 2.1 time: 0.041794 Aug 05 20:47:56.031871 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 303/571] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:55 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:47:56.042364 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e0730fc4-0bff-4518-b913-efcb357148c9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '.version_select at 0x7f9be76d2310>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:56.063246 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e0730fc4-0bff-4518-b913-efcb357148c9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331983520" status: 202 len: 0 microversion: 2.1 time: 0.025351 Aug 05 20:47:56.063986 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 269/572] 10.222.0.100 () {58 vars in 1226 bytes} [Fri Aug 5 20:47:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331983520 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:47:56.391975 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b72fcd57-7251-47a2-9bdd-fabcdd76cb06 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:56.394388 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b72fcd57-7251-47a2-9bdd-fabcdd76cb06 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:56.401175 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b72fcd57-7251-47a2-9bdd-fabcdd76cb06 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:56.401661 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b72fcd57-7251-47a2-9bdd-fabcdd76cb06 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:56.402066 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b72fcd57-7251-47a2-9bdd-fabcdd76cb06 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:56.402941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b72fcd57-7251-47a2-9bdd-fabcdd76cb06 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:56.403587 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b72fcd57-7251-47a2-9bdd-fabcdd76cb06 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:56.404555 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b72fcd57-7251-47a2-9bdd-fabcdd76cb06 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:56.500539 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b72fcd57-7251-47a2-9bdd-fabcdd76cb06 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "POST /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.112285 Aug 05 20:47:56.501267 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 304/573] 10.222.0.100 () {60 vars in 1283 bytes} [Fri Aug 5 20:47:56 2022] POST /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 20:47:56.509923 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-babebdc3-eca0-47e8-b789-48b9ec784fc0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:56.510696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-babebdc3-eca0-47e8-b789-48b9ec784fc0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:56.518082 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-babebdc3-eca0-47e8-b789-48b9ec784fc0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:56.518976 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-babebdc3-eca0-47e8-b789-48b9ec784fc0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:56.519975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-babebdc3-eca0-47e8-b789-48b9ec784fc0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:56.520767 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-babebdc3-eca0-47e8-b789-48b9ec784fc0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:56.521513 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-babebdc3-eca0-47e8-b789-48b9ec784fc0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:56.522306 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-babebdc3-eca0-47e8-b789-48b9ec784fc0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:56.657554 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-6e9050bc-5a97-4e2d-917b-fe4a2706bce0 req-d102be47-27a7-4e5f-be38-d1019cf59c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34d5df9-1498-4fdd-a688-5d8bad899a6f", "tag": "eaa0d3a0-5e0f-465f-ac62-8d0749b1809c"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:56.672350 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-6e9050bc-5a97-4e2d-917b-fe4a2706bce0 req-d102be47-27a7-4e5f-be38-d1019cf59c7e service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:56.673038 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-6e9050bc-5a97-4e2d-917b-fe4a2706bce0 req-d102be47-27a7-4e5f-be38-d1019cf59c7e service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:56.673657 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-6e9050bc-5a97-4e2d-917b-fe4a2706bce0 req-d102be47-27a7-4e5f-be38-d1019cf59c7e service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:56.686603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-6e9050bc-5a97-4e2d-917b-fe4a2706bce0 req-d102be47-27a7-4e5f-be38-d1019cf59c7e service nova] Creating event network-changed:eaa0d3a0-5e0f-465f-ac62-8d0749b1809c for instance c34d5df9-1498-4fdd-a688-5d8bad899a6f on hv-cinder-85220 Aug 05 20:47:56.692524 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-6e9050bc-5a97-4e2d-917b-fe4a2706bce0 req-d102be47-27a7-4e5f-be38-d1019cf59c7e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039426 Aug 05 20:47:56.695981 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 305/574] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:56.701822 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fac42f17-dd07-4070-bd9d-b621bbe5885e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:56.702767 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fac42f17-dd07-4070-bd9d-b621bbe5885e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:56.709782 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fac42f17-dd07-4070-bd9d-b621bbe5885e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:56.710286 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fac42f17-dd07-4070-bd9d-b621bbe5885e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:56.710727 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fac42f17-dd07-4070-bd9d-b621bbe5885e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:56.711482 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fac42f17-dd07-4070-bd9d-b621bbe5885e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:56.711942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fac42f17-dd07-4070-bd9d-b621bbe5885e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:56.712579 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fac42f17-dd07-4070-bd9d-b621bbe5885e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:57.148847 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-babebdc3-eca0-47e8-b789-48b9ec784fc0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:57.163654 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-babebdc3-eca0-47e8-b789-48b9ec784fc0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1754 microversion: 2.1 time: 0.657045 Aug 05 20:47:57.164915 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 270/575] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:56 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1754 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:57.213281 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fac42f17-dd07-4070-bd9d-b621bbe5885e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:57.235679 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fac42f17-dd07-4070-bd9d-b621bbe5885e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1680 microversion: 2.1 time: 0.538121 Aug 05 20:47:57.237434 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 306/576] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:56 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1680 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:57.619726 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-919a160b-067b-4467-8776-be66de1ea469 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Action: 'create', calling method: .version_select at 0x7f9be75daca0>, body: {"keypair": {"name": "tempest-keypair-1641989337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4FepzeZYzklIaEneCqk26ET3VclYH516GQMDP38KtF5zKk6LXkmRW+RtfHPMQapSUrhu76hbnlG9s2hwK/TIbp3R1uqNYBmeiWlvL/Bu8kz6f3iE6LfC/1WlIl6zU6aw=="}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:57.636288 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-919a160b-067b-4467-8776-be66de1ea469 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for project 8b67138a484f481099c562d7e3ca8401. Resources: {'key_pairs'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:47:57.640205 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-919a160b-067b-4467-8776-be66de1ea469 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for user 8e1baad75342476aa0c64bda0414e334 and project 8b67138a484f481099c562d7e3ca8401. Resources: {'key_pairs'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:47:57.665722 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-919a160b-067b-4467-8776-be66de1ea469 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055527 Aug 05 20:47:57.666333 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 271/577] 10.222.0.100 () {60 vars in 1164 bytes} [Fri Aug 5 20:47:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:47:58.185229 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6a9bb49e-6c69-4376-9802-94db92f1a358 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:58.185922 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6a9bb49e-6c69-4376-9802-94db92f1a358 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:58.192794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6a9bb49e-6c69-4376-9802-94db92f1a358 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:58.193283 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6a9bb49e-6c69-4376-9802-94db92f1a358 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:58.193778 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6a9bb49e-6c69-4376-9802-94db92f1a358 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:58.194395 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6a9bb49e-6c69-4376-9802-94db92f1a358 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:58.195069 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6a9bb49e-6c69-4376-9802-94db92f1a358 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:58.195557 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6a9bb49e-6c69-4376-9802-94db92f1a358 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:58.256945 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-54549b26-6422-4471-9dfe-66eaaf5ffcd0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:58.257577 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-54549b26-6422-4471-9dfe-66eaaf5ffcd0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:58.259594 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:58.266331 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54549b26-6422-4471-9dfe-66eaaf5ffcd0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:58.266963 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54549b26-6422-4471-9dfe-66eaaf5ffcd0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:58.267341 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54549b26-6422-4471-9dfe-66eaaf5ffcd0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:58.268067 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54549b26-6422-4471-9dfe-66eaaf5ffcd0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:58.268696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54549b26-6422-4471-9dfe-66eaaf5ffcd0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:58.269346 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54549b26-6422-4471-9dfe-66eaaf5ffcd0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:58.534092 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6a9bb49e-6c69-4376-9802-94db92f1a358 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:58.542482 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6a9bb49e-6c69-4376-9802-94db92f1a358 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1759 microversion: 2.1 time: 0.361269 Aug 05 20:47:58.543313 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 307/578] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:58 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1759 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:58.587012 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-54549b26-6422-4471-9dfe-66eaaf5ffcd0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:58.594768 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-54549b26-6422-4471-9dfe-66eaaf5ffcd0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1680 microversion: 2.1 time: 0.341794 Aug 05 20:47:58.595348 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 272/579] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:58 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1680 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:59.227142 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1875983074", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9bbc8caf-4605-4dc8-9bf5-6e59e633b041"}], "security_groups": [{"name": "tempest-securitygroup--1438218435"}], "key_name": "tempest-keypair-1641989337", "user_data": "}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:47:59.344402 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] validate_networks() for [('9bbc8caf-4605-4dc8-9bf5-6e59e633b041', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:47:59.459796 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=4 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:47:59.564366 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-92835627-2d2b-492e-a803-521c1f6f1ec9 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:59.564996 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-92835627-2d2b-492e-a803-521c1f6f1ec9 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:59.572606 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-92835627-2d2b-492e-a803-521c1f6f1ec9 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:59.573428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-92835627-2d2b-492e-a803-521c1f6f1ec9 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:59.574095 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-92835627-2d2b-492e-a803-521c1f6f1ec9 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:59.575200 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-92835627-2d2b-492e-a803-521c1f6f1ec9 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:59.577766 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-92835627-2d2b-492e-a803-521c1f6f1ec9 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:59.578394 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-92835627-2d2b-492e-a803-521c1f6f1ec9 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:59.828307 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-92835627-2d2b-492e-a803-521c1f6f1ec9 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:47:59.831963 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:47:59.832486 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:47:59.832988 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:47:59.833396 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:47:59.833835 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:47:59.837264 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-92835627-2d2b-492e-a803-521c1f6f1ec9 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1759 microversion: 2.1 time: 0.276772 Aug 05 20:47:59.837876 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 273/580] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:59 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1759 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:47:59.842539 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9684f6c8-a3ec-453e-b254-37d7a67416e6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:59.843146 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9684f6c8-a3ec-453e-b254-37d7a67416e6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:47:59.849342 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9684f6c8-a3ec-453e-b254-37d7a67416e6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:59.849832 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9684f6c8-a3ec-453e-b254-37d7a67416e6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:59.850267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9684f6c8-a3ec-453e-b254-37d7a67416e6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:59.851296 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9684f6c8-a3ec-453e-b254-37d7a67416e6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:59.851452 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9684f6c8-a3ec-453e-b254-37d7a67416e6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:59.851833 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9684f6c8-a3ec-453e-b254-37d7a67416e6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:59.853793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:59.854263 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:59.854714 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:59.855470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:47:59.855991 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:47:59.856612 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:47:59.882681 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for project 8b67138a484f481099c562d7e3ca8401. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:47:59.886765 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for user 8e1baad75342476aa0c64bda0414e334 and project 8b67138a484f481099c562d7e3ca8401. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:47:59.898330 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:47:59.900656 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:47:59.949470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0893c9f8-0ed8-4676-9db7-d4e269e8180e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.727884 Aug 05 20:47:59.955798 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 308/581] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:47:59 2022] POST /compute/v2.1/servers => generated 404 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:47:59.960878 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0f3b60d6-4d3a-4f61-805b-871852c95cec tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:47:59.961503 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0f3b60d6-4d3a-4f61-805b-871852c95cec tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:00.036260 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0f3b60d6-4d3a-4f61-805b-871852c95cec tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:00.040945 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-9684f6c8-a3ec-453e-b254-37d7a67416e6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:00.043474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0f3b60d6-4d3a-4f61-805b-871852c95cec tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1246 microversion: 2.1 time: 0.086321 Aug 05 20:48:00.044369 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 309/582] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:59 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:00.046553 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=100 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:00.051731 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9684f6c8-a3ec-453e-b254-37d7a67416e6 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1657 microversion: 2.1 time: 0.212773 Aug 05 20:48:00.052297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 274/583] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:47:59 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1657 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:00.072098 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f0137208-a402-43c9-8cfe-305fcc1702ad tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:00.079205 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f0137208-a402-43c9-8cfe-305fcc1702ad tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:00.079681 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f0137208-a402-43c9-8cfe-305fcc1702ad tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:00.080076 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f0137208-a402-43c9-8cfe-305fcc1702ad tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:00.102539 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f0137208-a402-43c9-8cfe-305fcc1702ad tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Going to try to start instance {{(pid=124432) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 20:48:00.160130 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f0137208-a402-43c9-8cfe-305fcc1702ad tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "POST /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/action" status: 202 len: 0 microversion: 2.1 time: 0.091604 Aug 05 20:48:00.160735 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 310/584] 10.222.0.100 () {60 vars in 1283 bytes} [Fri Aug 5 20:48:00 2022] POST /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:48:00.169193 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7e323578-533d-4f81-b5bf-35c3041ebdc7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:00.169897 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-7e323578-533d-4f81-b5bf-35c3041ebdc7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:00.177041 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e323578-533d-4f81-b5bf-35c3041ebdc7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:00.177624 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e323578-533d-4f81-b5bf-35c3041ebdc7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:00.178055 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e323578-533d-4f81-b5bf-35c3041ebdc7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:00.178784 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e323578-533d-4f81-b5bf-35c3041ebdc7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:00.179238 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e323578-533d-4f81-b5bf-35c3041ebdc7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:00.179702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e323578-533d-4f81-b5bf-35c3041ebdc7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:00.346158 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7e323578-533d-4f81-b5bf-35c3041ebdc7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:00.354299 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-7e323578-533d-4f81-b5bf-35c3041ebdc7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1666 microversion: 2.1 time: 0.188976 Aug 05 20:48:00.356120 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 275/585] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:00 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1666 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:48:00.859622 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8fc86731-7cb4-4dab-89b9-4d02300000eb tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:00.860321 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8fc86731-7cb4-4dab-89b9-4d02300000eb tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:00.867803 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8fc86731-7cb4-4dab-89b9-4d02300000eb tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:00.868313 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8fc86731-7cb4-4dab-89b9-4d02300000eb tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:00.868809 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8fc86731-7cb4-4dab-89b9-4d02300000eb tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:00.869574 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8fc86731-7cb4-4dab-89b9-4d02300000eb tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:00.870024 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8fc86731-7cb4-4dab-89b9-4d02300000eb tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:00.870448 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8fc86731-7cb4-4dab-89b9-4d02300000eb tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:01.065601 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-88a410b3-b765-458e-944d-bdb949d25890 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:01.066324 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-88a410b3-b765-458e-944d-bdb949d25890 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:01.077134 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-88a410b3-b765-458e-944d-bdb949d25890 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:01.078704 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-88a410b3-b765-458e-944d-bdb949d25890 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:01.079340 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-88a410b3-b765-458e-944d-bdb949d25890 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:01.082499 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-88a410b3-b765-458e-944d-bdb949d25890 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:01.086609 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-88a410b3-b765-458e-944d-bdb949d25890 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:01.087218 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-88a410b3-b765-458e-944d-bdb949d25890 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:01.092810 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8fc86731-7cb4-4dab-89b9-4d02300000eb tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:01.119454 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8fc86731-7cb4-4dab-89b9-4d02300000eb tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1759 microversion: 2.1 time: 0.264665 Aug 05 20:48:01.120630 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 311/586] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:00 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1759 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:01.176528 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-88a410b3-b765-458e-944d-bdb949d25890 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:01.184648 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-88a410b3-b765-458e-944d-bdb949d25890 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1306 microversion: 2.1 time: 0.123214 Aug 05 20:48:01.185303 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 276/587] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:01 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1306 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:48:01.380711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b16b5dda-f544-4aba-bb83-8c397a31a262 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:01.381663 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b16b5dda-f544-4aba-bb83-8c397a31a262 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:01.391173 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b16b5dda-f544-4aba-bb83-8c397a31a262 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:01.391979 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b16b5dda-f544-4aba-bb83-8c397a31a262 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:01.392682 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b16b5dda-f544-4aba-bb83-8c397a31a262 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:01.393821 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b16b5dda-f544-4aba-bb83-8c397a31a262 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:01.394529 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b16b5dda-f544-4aba-bb83-8c397a31a262 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:01.395770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b16b5dda-f544-4aba-bb83-8c397a31a262 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:01.544272 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b16b5dda-f544-4aba-bb83-8c397a31a262 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:01.552176 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b16b5dda-f544-4aba-bb83-8c397a31a262 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1666 microversion: 2.1 time: 0.178738 Aug 05 20:48:01.552792 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 312/588] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:01 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1666 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:02.140930 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4135170d-06d4-4d42-8712-7bb073a23b35 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:02.141556 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4135170d-06d4-4d42-8712-7bb073a23b35 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:02.148914 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4135170d-06d4-4d42-8712-7bb073a23b35 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:02.149387 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4135170d-06d4-4d42-8712-7bb073a23b35 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:02.149822 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4135170d-06d4-4d42-8712-7bb073a23b35 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:02.150505 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4135170d-06d4-4d42-8712-7bb073a23b35 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:02.151134 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4135170d-06d4-4d42-8712-7bb073a23b35 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:02.151777 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4135170d-06d4-4d42-8712-7bb073a23b35 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:02.206050 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-bd0b555a-a6d9-4bc3-9038-610705613436 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:02.207580 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-bd0b555a-a6d9-4bc3-9038-610705613436 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:02.215076 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bd0b555a-a6d9-4bc3-9038-610705613436 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:02.215866 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bd0b555a-a6d9-4bc3-9038-610705613436 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:02.216303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bd0b555a-a6d9-4bc3-9038-610705613436 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:02.216990 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bd0b555a-a6d9-4bc3-9038-610705613436 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:02.217635 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bd0b555a-a6d9-4bc3-9038-610705613436 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:02.218078 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bd0b555a-a6d9-4bc3-9038-610705613436 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:02.352342 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4135170d-06d4-4d42-8712-7bb073a23b35 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:02.367816 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4135170d-06d4-4d42-8712-7bb073a23b35 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1759 microversion: 2.1 time: 0.230079 Aug 05 20:48:02.369158 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 277/589] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:02 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1759 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:02.408117 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-bd0b555a-a6d9-4bc3-9038-610705613436 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:02.428322 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-bd0b555a-a6d9-4bc3-9038-610705613436 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1372 microversion: 2.1 time: 0.225025 Aug 05 20:48:02.433380 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 313/590] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:02 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:02.573873 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7b382e8b-74dc-4d75-b6e5-216ce0fe19fb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:02.574521 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-7b382e8b-74dc-4d75-b6e5-216ce0fe19fb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:02.580827 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7b382e8b-74dc-4d75-b6e5-216ce0fe19fb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:02.581309 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7b382e8b-74dc-4d75-b6e5-216ce0fe19fb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:02.581746 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7b382e8b-74dc-4d75-b6e5-216ce0fe19fb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:02.582435 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7b382e8b-74dc-4d75-b6e5-216ce0fe19fb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:02.583425 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7b382e8b-74dc-4d75-b6e5-216ce0fe19fb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:02.583888 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7b382e8b-74dc-4d75-b6e5-216ce0fe19fb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:02.721807 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7b382e8b-74dc-4d75-b6e5-216ce0fe19fb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:02.730354 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-7b382e8b-74dc-4d75-b6e5-216ce0fe19fb tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1670 microversion: 2.1 time: 0.160407 Aug 05 20:48:02.730933 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 278/591] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:02 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:02.949358 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-29b60f96-b188-4df2-bcb8-b472b59d5b74 req-0a4c8fbb-e4b1-4655-873c-b0a66636eb9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26a70e3c-12e4-4459-b22d-b9152f1987c1", "tag": "7ee68135-83de-4b1e-a4b4-40f2021dc25f"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:02.972735 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-29b60f96-b188-4df2-bcb8-b472b59d5b74 req-0a4c8fbb-e4b1-4655-873c-b0a66636eb9c service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:02.973438 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-29b60f96-b188-4df2-bcb8-b472b59d5b74 req-0a4c8fbb-e4b1-4655-873c-b0a66636eb9c service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:02.973871 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-29b60f96-b188-4df2-bcb8-b472b59d5b74 req-0a4c8fbb-e4b1-4655-873c-b0a66636eb9c service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:02.985413 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-29b60f96-b188-4df2-bcb8-b472b59d5b74 req-0a4c8fbb-e4b1-4655-873c-b0a66636eb9c service nova] Creating event network-changed:7ee68135-83de-4b1e-a4b4-40f2021dc25f for instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 on hv-cinder-85220 Aug 05 20:48:02.991378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-29b60f96-b188-4df2-bcb8-b472b59d5b74 req-0a4c8fbb-e4b1-4655-873c-b0a66636eb9c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045760 Aug 05 20:48:02.991976 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 314/592] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:48:03.391205 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-6956f584-3036-4e5e-85d1-c2035516b69f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:03.392125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-6956f584-3036-4e5e-85d1-c2035516b69f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:03.401262 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6956f584-3036-4e5e-85d1-c2035516b69f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:03.401867 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6956f584-3036-4e5e-85d1-c2035516b69f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:03.402404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6956f584-3036-4e5e-85d1-c2035516b69f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:03.403257 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6956f584-3036-4e5e-85d1-c2035516b69f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:03.404197 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6956f584-3036-4e5e-85d1-c2035516b69f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:03.404728 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6956f584-3036-4e5e-85d1-c2035516b69f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:03.455323 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f4a3e544-4c3e-4219-b067-c439da3b178c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:03.456135 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f4a3e544-4c3e-4219-b067-c439da3b178c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:03.463962 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f4a3e544-4c3e-4219-b067-c439da3b178c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:03.464738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f4a3e544-4c3e-4219-b067-c439da3b178c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:03.465403 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f4a3e544-4c3e-4219-b067-c439da3b178c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:03.466448 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f4a3e544-4c3e-4219-b067-c439da3b178c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:03.467131 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f4a3e544-4c3e-4219-b067-c439da3b178c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:03.467808 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f4a3e544-4c3e-4219-b067-c439da3b178c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:03.602732 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-6956f584-3036-4e5e-85d1-c2035516b69f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:03.612500 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-6956f584-3036-4e5e-85d1-c2035516b69f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1759 microversion: 2.1 time: 0.226116 Aug 05 20:48:03.613415 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 279/593] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:03 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1759 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:03.658384 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f4a3e544-4c3e-4219-b067-c439da3b178c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:03.666802 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f4a3e544-4c3e-4219-b067-c439da3b178c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1372 microversion: 2.1 time: 0.216221 Aug 05 20:48:03.667394 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 315/594] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:03 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:04.635215 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-6cbf68fc-8c7d-4a83-a1fc-1392413c44a7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:04.636017 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-6cbf68fc-8c7d-4a83-a1fc-1392413c44a7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:04.644080 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6cbf68fc-8c7d-4a83-a1fc-1392413c44a7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:04.644701 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6cbf68fc-8c7d-4a83-a1fc-1392413c44a7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:04.645228 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6cbf68fc-8c7d-4a83-a1fc-1392413c44a7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:04.646044 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6cbf68fc-8c7d-4a83-a1fc-1392413c44a7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:04.646582 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6cbf68fc-8c7d-4a83-a1fc-1392413c44a7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:04.647091 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6cbf68fc-8c7d-4a83-a1fc-1392413c44a7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:04.687708 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-21f081e4-d2f8-4fd3-b74e-fd081dc0445c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:04.688424 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-21f081e4-d2f8-4fd3-b74e-fd081dc0445c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:04.695629 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-21f081e4-d2f8-4fd3-b74e-fd081dc0445c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:04.696124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-21f081e4-d2f8-4fd3-b74e-fd081dc0445c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:04.696557 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-21f081e4-d2f8-4fd3-b74e-fd081dc0445c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:04.697317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-21f081e4-d2f8-4fd3-b74e-fd081dc0445c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:04.697746 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-21f081e4-d2f8-4fd3-b74e-fd081dc0445c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:04.698226 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-21f081e4-d2f8-4fd3-b74e-fd081dc0445c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:04.857665 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-6cbf68fc-8c7d-4a83-a1fc-1392413c44a7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:04.866718 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-6cbf68fc-8c7d-4a83-a1fc-1392413c44a7 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1759 microversion: 2.1 time: 0.236146 Aug 05 20:48:04.867289 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 280/595] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:04 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1759 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:04.881376 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-21f081e4-d2f8-4fd3-b74e-fd081dc0445c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:04.889184 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-21f081e4-d2f8-4fd3-b74e-fd081dc0445c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1372 microversion: 2.1 time: 0.205404 Aug 05 20:48:04.889741 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 316/596] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:04 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1372 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:05.888352 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-5b2add71-db5c-457e-a0a6-2bb4fdbe81d2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:05.889099 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-5b2add71-db5c-457e-a0a6-2bb4fdbe81d2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:05.898325 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5b2add71-db5c-457e-a0a6-2bb4fdbe81d2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:05.899199 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5b2add71-db5c-457e-a0a6-2bb4fdbe81d2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:05.899854 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5b2add71-db5c-457e-a0a6-2bb4fdbe81d2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:05.900731 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5b2add71-db5c-457e-a0a6-2bb4fdbe81d2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:05.901328 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5b2add71-db5c-457e-a0a6-2bb4fdbe81d2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:05.901895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5b2add71-db5c-457e-a0a6-2bb4fdbe81d2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:05.911158 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-dd9d0aef-04bd-484b-845f-b8f190e6e607 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:05.912358 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-dd9d0aef-04bd-484b-845f-b8f190e6e607 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:05.924119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd9d0aef-04bd-484b-845f-b8f190e6e607 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:05.926674 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd9d0aef-04bd-484b-845f-b8f190e6e607 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:05.928714 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd9d0aef-04bd-484b-845f-b8f190e6e607 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:05.930578 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd9d0aef-04bd-484b-845f-b8f190e6e607 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:05.931040 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd9d0aef-04bd-484b-845f-b8f190e6e607 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:05.931496 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-dd9d0aef-04bd-484b-845f-b8f190e6e607 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:06.246030 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-5b2add71-db5c-457e-a0a6-2bb4fdbe81d2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:06.251398 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-dd9d0aef-04bd-484b-845f-b8f190e6e607 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:06.255026 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-5b2add71-db5c-457e-a0a6-2bb4fdbe81d2 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1759 microversion: 2.1 time: 0.370346 Aug 05 20:48:06.256074 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 281/597] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:05 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1759 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:06.260892 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-dd9d0aef-04bd-484b-845f-b8f190e6e607 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1372 microversion: 2.1 time: 0.354379 Aug 05 20:48:06.261638 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 317/598] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:05 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1372 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:07.279043 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3905d37e-fac9-44fb-aa61-9f7a58fc578d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:07.279835 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3905d37e-fac9-44fb-aa61-9f7a58fc578d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:07.284370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-67535844-03ee-42d3-b376-6b3dc21cd52f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:07.285256 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-67535844-03ee-42d3-b376-6b3dc21cd52f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:07.288744 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3905d37e-fac9-44fb-aa61-9f7a58fc578d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:07.289962 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3905d37e-fac9-44fb-aa61-9f7a58fc578d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:07.289962 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3905d37e-fac9-44fb-aa61-9f7a58fc578d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:07.290933 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3905d37e-fac9-44fb-aa61-9f7a58fc578d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:07.291587 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3905d37e-fac9-44fb-aa61-9f7a58fc578d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:07.292136 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3905d37e-fac9-44fb-aa61-9f7a58fc578d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:07.294170 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-67535844-03ee-42d3-b376-6b3dc21cd52f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:07.294810 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-67535844-03ee-42d3-b376-6b3dc21cd52f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:07.295390 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-67535844-03ee-42d3-b376-6b3dc21cd52f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:07.296537 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-67535844-03ee-42d3-b376-6b3dc21cd52f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:07.297140 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-67535844-03ee-42d3-b376-6b3dc21cd52f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:07.297717 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-67535844-03ee-42d3-b376-6b3dc21cd52f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:07.301631 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:07.648665 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=4 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:07.807531 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-67535844-03ee-42d3-b376-6b3dc21cd52f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:07.814332 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3905d37e-fac9-44fb-aa61-9f7a58fc578d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:07.815110 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-67535844-03ee-42d3-b376-6b3dc21cd52f tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1372 microversion: 2.1 time: 0.536217 Aug 05 20:48:07.815705 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 318/599] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:07 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1372 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:07.823842 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3905d37e-fac9-44fb-aa61-9f7a58fc578d tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1759 microversion: 2.1 time: 0.550960 Aug 05 20:48:07.825057 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 282/600] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:07 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1759 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:07.873341 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-4a95e519-0c91-4b18-ac8e-b378a7fef743 req-d85ca854-af6a-4e4c-85fd-8e0b3f39efaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a70e3c-12e4-4459-b22d-b9152f1987c1", "name": "network-vif-plugged", "status": "completed", "tag": "7ee68135-83de-4b1e-a4b4-40f2021dc25f"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:07.883438 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-4a95e519-0c91-4b18-ac8e-b378a7fef743 req-d85ca854-af6a-4e4c-85fd-8e0b3f39efaa service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:07.883923 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-4a95e519-0c91-4b18-ac8e-b378a7fef743 req-d85ca854-af6a-4e4c-85fd-8e0b3f39efaa service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:07.884350 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-4a95e519-0c91-4b18-ac8e-b378a7fef743 req-d85ca854-af6a-4e4c-85fd-8e0b3f39efaa service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:07.896002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-4a95e519-0c91-4b18-ac8e-b378a7fef743 req-d85ca854-af6a-4e4c-85fd-8e0b3f39efaa service nova] Creating event network-vif-plugged:7ee68135-83de-4b1e-a4b4-40f2021dc25f for instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 on hv-cinder-85220 Aug 05 20:48:07.900977 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-4a95e519-0c91-4b18-ac8e-b378a7fef743 req-d85ca854-af6a-4e4c-85fd-8e0b3f39efaa service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031298 Aug 05 20:48:07.901494 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 319/601] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:48:08.837171 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d2c1be2e-6d78-48c7-99b6-dc96568fdf78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:08.837739 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d2c1be2e-6d78-48c7-99b6-dc96568fdf78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:08.844706 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d2c1be2e-6d78-48c7-99b6-dc96568fdf78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:08.845169 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d2c1be2e-6d78-48c7-99b6-dc96568fdf78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:08.845623 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d2c1be2e-6d78-48c7-99b6-dc96568fdf78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:08.846312 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d2c1be2e-6d78-48c7-99b6-dc96568fdf78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:08.846763 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d2c1be2e-6d78-48c7-99b6-dc96568fdf78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:08.846922 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4afeb8de-c75f-4e25-8c7c-89658feced8e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:08.847336 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d2c1be2e-6d78-48c7-99b6-dc96568fdf78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:08.847882 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4afeb8de-c75f-4e25-8c7c-89658feced8e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:08.854732 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4afeb8de-c75f-4e25-8c7c-89658feced8e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:08.855204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4afeb8de-c75f-4e25-8c7c-89658feced8e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:08.855677 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4afeb8de-c75f-4e25-8c7c-89658feced8e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:08.856409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4afeb8de-c75f-4e25-8c7c-89658feced8e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:08.856990 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4afeb8de-c75f-4e25-8c7c-89658feced8e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:08.857449 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4afeb8de-c75f-4e25-8c7c-89658feced8e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:09.049944 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d2c1be2e-6d78-48c7-99b6-dc96568fdf78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:09.058106 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d2c1be2e-6d78-48c7-99b6-dc96568fdf78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1372 microversion: 2.1 time: 0.224929 Aug 05 20:48:09.058691 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 283/602] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:08 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1372 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:09.068111 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4afeb8de-c75f-4e25-8c7c-89658feced8e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:09.078685 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4afeb8de-c75f-4e25-8c7c-89658feced8e tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1759 microversion: 2.1 time: 0.236278 Aug 05 20:48:09.079442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 320/603] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:08 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1759 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:10.082562 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0deeb5e5-1747-45c4-b578-1d8bea92cb7c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:10.084209 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0deeb5e5-1747-45c4-b578-1d8bea92cb7c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:10.095426 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0deeb5e5-1747-45c4-b578-1d8bea92cb7c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:10.096267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0deeb5e5-1747-45c4-b578-1d8bea92cb7c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:10.097138 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0deeb5e5-1747-45c4-b578-1d8bea92cb7c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:10.098632 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0deeb5e5-1747-45c4-b578-1d8bea92cb7c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:10.099154 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0deeb5e5-1747-45c4-b578-1d8bea92cb7c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:10.099609 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0deeb5e5-1747-45c4-b578-1d8bea92cb7c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:10.102654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-544170bb-a228-47f3-af4c-28fe8fab6aad tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:10.103344 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-544170bb-a228-47f3-af4c-28fe8fab6aad tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:10.107025 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:10.107741 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=8 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:10.112412 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-544170bb-a228-47f3-af4c-28fe8fab6aad tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:10.112911 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-544170bb-a228-47f3-af4c-28fe8fab6aad tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:10.113397 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-544170bb-a228-47f3-af4c-28fe8fab6aad tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:10.114293 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-544170bb-a228-47f3-af4c-28fe8fab6aad tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:10.114754 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-544170bb-a228-47f3-af4c-28fe8fab6aad tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:10.115182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-544170bb-a228-47f3-af4c-28fe8fab6aad tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:10.297213 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0deeb5e5-1747-45c4-b578-1d8bea92cb7c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:10.306070 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0deeb5e5-1747-45c4-b578-1d8bea92cb7c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1372 microversion: 2.1 time: 0.230258 Aug 05 20:48:10.306879 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 284/604] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:10 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:10.322751 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-544170bb-a228-47f3-af4c-28fe8fab6aad tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:10.331434 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-544170bb-a228-47f3-af4c-28fe8fab6aad tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1759 microversion: 2.1 time: 0.233125 Aug 05 20:48:10.332036 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 321/605] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:10 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1759 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:10.738980 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-144443382", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1555072571", "security_groups": [{"name": "tempest-secgroup-smoke-1169758282"}], "block_device_mapping_v2": [{"uuid": "1858415e-1fd2-406a-a3ef-3ddfd791b5f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2da7eabb-8388-4a2d-b214-d5f4a8b84731"}]}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:10.873949 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.network.neutron [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] validate_networks() for [('2da7eabb-8388-4a2d-b214-d5f4a8b84731', None, None, None, None, None)] {{(pid=124431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:48:11.271449 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Flavor limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:48:11.271986 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Image limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:48:11.272371 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Flavor pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:48:11.272781 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Image pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:48:11.273223 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:48:11.283519 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:11.284009 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:11.284447 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:11.285169 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:11.286410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:11.286838 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:11.304734 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Getting quotas for project c671352d2d2c475ab5c58932b6ecf5bc. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:48:11.308773 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Getting quotas for user 9b5ea50e80674c9f96821af04540ba39 and project c671352d2d2c475ab5c58932b6ecf5bc. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:48:11.326082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-28eb05d5-112c-4c19-8390-09c684a8511a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:11.326817 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-28eb05d5-112c-4c19-8390-09c684a8511a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:11.329313 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:11.335240 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-28eb05d5-112c-4c19-8390-09c684a8511a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:11.335752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-28eb05d5-112c-4c19-8390-09c684a8511a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:11.336177 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-28eb05d5-112c-4c19-8390-09c684a8511a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:11.336870 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-28eb05d5-112c-4c19-8390-09c684a8511a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:11.337314 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-28eb05d5-112c-4c19-8390-09c684a8511a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:11.337731 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-28eb05d5-112c-4c19-8390-09c684a8511a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:11.378326 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Going to run 1 instances... {{(pid=124431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:48:11.380907 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1858415e-1fd2-406a-a3ef-3ddfd791b5f3',volume_size=None,volume_type=None)] {{(pid=124431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:48:11.477400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-28eb05d5-112c-4c19-8390-09c684a8511a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:11.485208 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-28eb05d5-112c-4c19-8390-09c684a8511a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1561 microversion: 2.1 time: 0.162926 Aug 05 20:48:11.485782 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 322/606] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:11 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:11.490552 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0ca3f7da-d4a9-46f2-941e-57d346c29b81 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:11.491164 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0ca3f7da-d4a9-46f2-941e-57d346c29b81 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:11.497217 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ca3f7da-d4a9-46f2-941e-57d346c29b81 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:11.497713 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ca3f7da-d4a9-46f2-941e-57d346c29b81 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:11.498150 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ca3f7da-d4a9-46f2-941e-57d346c29b81 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:11.498854 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ca3f7da-d4a9-46f2-941e-57d346c29b81 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:11.499311 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ca3f7da-d4a9-46f2-941e-57d346c29b81 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:11.499771 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0ca3f7da-d4a9-46f2-941e-57d346c29b81 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:11.520879 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-759c31d9-1e4d-45fb-abfe-6f82de4ba75a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.788169 Aug 05 20:48:11.522164 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 285/607] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:48:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:48:11.532984 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-51ecedd0-14df-4bb7-814b-f56dc2ca4881 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:11.533480 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-51ecedd0-14df-4bb7-814b-f56dc2ca4881 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:11.539992 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-51ecedd0-14df-4bb7-814b-f56dc2ca4881 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:11.540489 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-51ecedd0-14df-4bb7-814b-f56dc2ca4881 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:11.541043 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-51ecedd0-14df-4bb7-814b-f56dc2ca4881 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:11.541749 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-51ecedd0-14df-4bb7-814b-f56dc2ca4881 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:11.542205 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-51ecedd0-14df-4bb7-814b-f56dc2ca4881 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:11.542636 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-51ecedd0-14df-4bb7-814b-f56dc2ca4881 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:11.651084 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-51ecedd0-14df-4bb7-814b-f56dc2ca4881 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122156 Aug 05 20:48:11.652939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 286/608] 10.222.0.100 () {58 vars in 1280 bytes} [Fri Aug 5 20:48:11 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:48:11.659884 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-2f32bb33-7bff-444b-8dff-b9f9e68fdf01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:11.660214 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-2f32bb33-7bff-444b-8dff-b9f9e68fdf01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:11.709790 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0ca3f7da-d4a9-46f2-941e-57d346c29b81 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:11.719470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0ca3f7da-d4a9-46f2-941e-57d346c29b81 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1759 microversion: 2.1 time: 0.232367 Aug 05 20:48:11.720360 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 323/609] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:11 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1759 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:11.726906 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2f32bb33-7bff-444b-8dff-b9f9e68fdf01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:11.734997 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-2f32bb33-7bff-444b-8dff-b9f9e68fdf01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1097 microversion: 2.1 time: 0.082035 Aug 05 20:48:11.735594 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 287/610] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:11 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1097 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:12.682692 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-e146c3d5-70b9-4ef2-a357-552324dd6c57 req-44e472b8-893d-4101-a977-07a5c5d197da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26a70e3c-12e4-4459-b22d-b9152f1987c1", "tag": "7ee68135-83de-4b1e-a4b4-40f2021dc25f"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:12.692905 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-e146c3d5-70b9-4ef2-a357-552324dd6c57 req-44e472b8-893d-4101-a977-07a5c5d197da service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:12.693387 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-e146c3d5-70b9-4ef2-a357-552324dd6c57 req-44e472b8-893d-4101-a977-07a5c5d197da service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:12.693809 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-e146c3d5-70b9-4ef2-a357-552324dd6c57 req-44e472b8-893d-4101-a977-07a5c5d197da service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:12.705527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-e146c3d5-70b9-4ef2-a357-552324dd6c57 req-44e472b8-893d-4101-a977-07a5c5d197da service nova] Creating event network-changed:7ee68135-83de-4b1e-a4b4-40f2021dc25f for instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 on hv-cinder-85220 Aug 05 20:48:12.711811 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-e146c3d5-70b9-4ef2-a357-552324dd6c57 req-44e472b8-893d-4101-a977-07a5c5d197da service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033259 Aug 05 20:48:12.717669 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 324/611] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:48:12.741424 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-61a60e95-f30f-4823-a6f8-b4e2bcd848d0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:12.742989 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-61a60e95-f30f-4823-a6f8-b4e2bcd848d0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:12.750498 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-61a60e95-f30f-4823-a6f8-b4e2bcd848d0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:12.751519 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-61a60e95-f30f-4823-a6f8-b4e2bcd848d0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:12.752167 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-61a60e95-f30f-4823-a6f8-b4e2bcd848d0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:12.753625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-61a60e95-f30f-4823-a6f8-b4e2bcd848d0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:12.753844 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-61a60e95-f30f-4823-a6f8-b4e2bcd848d0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:12.754590 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-61a60e95-f30f-4823-a6f8-b4e2bcd848d0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:12.774666 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cf1b68a3-1577-47a9-a01c-ba54542e92d6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:12.776690 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cf1b68a3-1577-47a9-a01c-ba54542e92d6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:12.795631 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cf1b68a3-1577-47a9-a01c-ba54542e92d6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:12.799079 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cf1b68a3-1577-47a9-a01c-ba54542e92d6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:12.799548 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cf1b68a3-1577-47a9-a01c-ba54542e92d6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:12.800440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cf1b68a3-1577-47a9-a01c-ba54542e92d6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:12.801885 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cf1b68a3-1577-47a9-a01c-ba54542e92d6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:12.802710 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cf1b68a3-1577-47a9-a01c-ba54542e92d6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:12.956735 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cf1b68a3-1577-47a9-a01c-ba54542e92d6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:12.966780 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cf1b68a3-1577-47a9-a01c-ba54542e92d6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1213 microversion: 2.1 time: 0.207380 Aug 05 20:48:12.968699 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 325/612] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:12 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1213 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:13.032914 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-61a60e95-f30f-4823-a6f8-b4e2bcd848d0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:13.041838 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-61a60e95-f30f-4823-a6f8-b4e2bcd848d0 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1759 microversion: 2.1 time: 0.304419 Aug 05 20:48:13.042546 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 288/613] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:12 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1759 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:13.989718 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7b1e281a-e979-4b49-83eb-df16d049bb8a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:13.990325 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7b1e281a-e979-4b49-83eb-df16d049bb8a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:13.997250 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7b1e281a-e979-4b49-83eb-df16d049bb8a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:13.997768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7b1e281a-e979-4b49-83eb-df16d049bb8a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:13.998201 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7b1e281a-e979-4b49-83eb-df16d049bb8a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:13.998892 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7b1e281a-e979-4b49-83eb-df16d049bb8a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:13.999338 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7b1e281a-e979-4b49-83eb-df16d049bb8a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:13.999797 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7b1e281a-e979-4b49-83eb-df16d049bb8a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:14.065353 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0b9a7908-94c8-4cf4-95fb-692835f26290 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:14.066071 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0b9a7908-94c8-4cf4-95fb-692835f26290 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:14.075396 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b9a7908-94c8-4cf4-95fb-692835f26290 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:14.075937 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b9a7908-94c8-4cf4-95fb-692835f26290 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:14.076528 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b9a7908-94c8-4cf4-95fb-692835f26290 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:14.077504 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b9a7908-94c8-4cf4-95fb-692835f26290 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:14.077975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b9a7908-94c8-4cf4-95fb-692835f26290 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:14.078405 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b9a7908-94c8-4cf4-95fb-692835f26290 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:14.189929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7b1e281a-e979-4b49-83eb-df16d049bb8a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:14.198494 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7b1e281a-e979-4b49-83eb-df16d049bb8a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1269 microversion: 2.1 time: 0.213231 Aug 05 20:48:14.199175 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 326/614] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:13 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1269 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:14.249051 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0b9a7908-94c8-4cf4-95fb-692835f26290 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:14.257510 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0b9a7908-94c8-4cf4-95fb-692835f26290 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1762 microversion: 2.1 time: 0.196288 Aug 05 20:48:14.258091 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 289/615] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:14 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1762 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:14.954453 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-925aaec5-ed72-424e-8c70-facbc32eccf9 req-d5c19177-ebd0-45f7-b4f9-b9d56395c698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c7ca7c-10a8-4b62-a82e-01b05bd4cf19", "tag": "a2fcfeb9-5c68-48c4-8cf9-887f89995b6e"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:14.965934 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-925aaec5-ed72-424e-8c70-facbc32eccf9 req-d5c19177-ebd0-45f7-b4f9-b9d56395c698 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:14.966599 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-925aaec5-ed72-424e-8c70-facbc32eccf9 req-d5c19177-ebd0-45f7-b4f9-b9d56395c698 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:14.967200 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-925aaec5-ed72-424e-8c70-facbc32eccf9 req-d5c19177-ebd0-45f7-b4f9-b9d56395c698 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:14.979791 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-925aaec5-ed72-424e-8c70-facbc32eccf9 req-d5c19177-ebd0-45f7-b4f9-b9d56395c698 service nova] Creating event network-changed:a2fcfeb9-5c68-48c4-8cf9-887f89995b6e for instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 on hv-cinder-85220 Aug 05 20:48:14.984969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-925aaec5-ed72-424e-8c70-facbc32eccf9 req-d5c19177-ebd0-45f7-b4f9-b9d56395c698 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034352 Aug 05 20:48:14.985555 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 327/616] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:48:15.220611 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3c556933-9eaf-4255-a43c-64219a080b91 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:15.221131 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3c556933-9eaf-4255-a43c-64219a080b91 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:15.228198 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3c556933-9eaf-4255-a43c-64219a080b91 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:15.228695 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3c556933-9eaf-4255-a43c-64219a080b91 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:15.229136 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3c556933-9eaf-4255-a43c-64219a080b91 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:15.229836 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3c556933-9eaf-4255-a43c-64219a080b91 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:15.230291 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3c556933-9eaf-4255-a43c-64219a080b91 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:15.230718 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3c556933-9eaf-4255-a43c-64219a080b91 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:15.445763 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3c556933-9eaf-4255-a43c-64219a080b91 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:15.454270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3c556933-9eaf-4255-a43c-64219a080b91 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1269 microversion: 2.1 time: 0.237695 Aug 05 20:48:15.454877 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 290/617] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:15 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1269 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:16.479396 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7be30b8c-6e3f-47fa-8be3-33d81f684416 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:16.480345 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7be30b8c-6e3f-47fa-8be3-33d81f684416 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:16.489258 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7be30b8c-6e3f-47fa-8be3-33d81f684416 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:16.489675 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7be30b8c-6e3f-47fa-8be3-33d81f684416 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:16.490187 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7be30b8c-6e3f-47fa-8be3-33d81f684416 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:16.490823 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7be30b8c-6e3f-47fa-8be3-33d81f684416 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:16.491287 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7be30b8c-6e3f-47fa-8be3-33d81f684416 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:16.491732 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7be30b8c-6e3f-47fa-8be3-33d81f684416 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:16.638189 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7be30b8c-6e3f-47fa-8be3-33d81f684416 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:16.647053 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7be30b8c-6e3f-47fa-8be3-33d81f684416 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1269 microversion: 2.1 time: 0.174150 Aug 05 20:48:16.647671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 328/618] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:16 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:17.668617 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1cd97d9c-4ebb-4393-83dc-71538013a1c8 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:17.669255 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-1cd97d9c-4ebb-4393-83dc-71538013a1c8 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:17.675913 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1cd97d9c-4ebb-4393-83dc-71538013a1c8 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:17.676666 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1cd97d9c-4ebb-4393-83dc-71538013a1c8 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:17.677106 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1cd97d9c-4ebb-4393-83dc-71538013a1c8 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:17.677788 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1cd97d9c-4ebb-4393-83dc-71538013a1c8 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:17.678240 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1cd97d9c-4ebb-4393-83dc-71538013a1c8 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:17.678661 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1cd97d9c-4ebb-4393-83dc-71538013a1c8 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:17.821580 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-1cd97d9c-4ebb-4393-83dc-71538013a1c8 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:17.829696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-1cd97d9c-4ebb-4393-83dc-71538013a1c8 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1269 microversion: 2.1 time: 0.165139 Aug 05 20:48:17.830271 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 291/619] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:17 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:18.851425 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-14a3dba0-dbb7-44cf-a306-1c3be7d9d391 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:18.852084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-14a3dba0-dbb7-44cf-a306-1c3be7d9d391 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:18.862219 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-14a3dba0-dbb7-44cf-a306-1c3be7d9d391 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:18.862860 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-14a3dba0-dbb7-44cf-a306-1c3be7d9d391 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:18.863340 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-14a3dba0-dbb7-44cf-a306-1c3be7d9d391 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:18.865042 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-14a3dba0-dbb7-44cf-a306-1c3be7d9d391 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:18.865661 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-14a3dba0-dbb7-44cf-a306-1c3be7d9d391 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:18.866184 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-14a3dba0-dbb7-44cf-a306-1c3be7d9d391 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:19.012992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-14a3dba0-dbb7-44cf-a306-1c3be7d9d391 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:19.020811 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-14a3dba0-dbb7-44cf-a306-1c3be7d9d391 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1269 microversion: 2.1 time: 0.174015 Aug 05 20:48:19.021384 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 329/620] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:18 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1269 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:20.048696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-29fb1aff-13de-4af5-b41e-9f106d3d9184 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:20.049273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-29fb1aff-13de-4af5-b41e-9f106d3d9184 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:20.057307 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-29fb1aff-13de-4af5-b41e-9f106d3d9184 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:20.057803 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-29fb1aff-13de-4af5-b41e-9f106d3d9184 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:20.058241 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-29fb1aff-13de-4af5-b41e-9f106d3d9184 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:20.058988 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-29fb1aff-13de-4af5-b41e-9f106d3d9184 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:20.059517 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-29fb1aff-13de-4af5-b41e-9f106d3d9184 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:20.059968 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-29fb1aff-13de-4af5-b41e-9f106d3d9184 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:20.224337 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-29fb1aff-13de-4af5-b41e-9f106d3d9184 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:20.232770 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-29fb1aff-13de-4af5-b41e-9f106d3d9184 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1269 microversion: 2.1 time: 0.188106 Aug 05 20:48:20.233310 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 292/621] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:20 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1269 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:21.256839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ccf0a194-b716-4b7f-945f-3e350b715c4a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:21.257411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ccf0a194-b716-4b7f-945f-3e350b715c4a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:21.264436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccf0a194-b716-4b7f-945f-3e350b715c4a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:21.264928 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccf0a194-b716-4b7f-945f-3e350b715c4a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:21.265345 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccf0a194-b716-4b7f-945f-3e350b715c4a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:21.266043 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccf0a194-b716-4b7f-945f-3e350b715c4a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:21.266501 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccf0a194-b716-4b7f-945f-3e350b715c4a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:21.266961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccf0a194-b716-4b7f-945f-3e350b715c4a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:21.408670 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ccf0a194-b716-4b7f-945f-3e350b715c4a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:21.419092 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ccf0a194-b716-4b7f-945f-3e350b715c4a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1269 microversion: 2.1 time: 0.167562 Aug 05 20:48:21.419976 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 330/622] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:21 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:22.440375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-cf1455cb-1d92-4fc6-88d1-7b86ced2d0c6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:22.440967 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-cf1455cb-1d92-4fc6-88d1-7b86ced2d0c6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:22.443674 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:22.444485 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=8 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:22.450831 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cf1455cb-1d92-4fc6-88d1-7b86ced2d0c6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:22.451320 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cf1455cb-1d92-4fc6-88d1-7b86ced2d0c6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:22.451785 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cf1455cb-1d92-4fc6-88d1-7b86ced2d0c6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:22.452484 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cf1455cb-1d92-4fc6-88d1-7b86ced2d0c6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:22.452932 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cf1455cb-1d92-4fc6-88d1-7b86ced2d0c6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:22.453355 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cf1455cb-1d92-4fc6-88d1-7b86ced2d0c6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:22.472012 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=100 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:22.588482 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-cf1455cb-1d92-4fc6-88d1-7b86ced2d0c6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:22.596597 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-cf1455cb-1d92-4fc6-88d1-7b86ced2d0c6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1269 microversion: 2.1 time: 0.160218 Aug 05 20:48:22.597176 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 293/623] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:22 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:23.449442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9acd69cc-1d50-4b87-a831-559328ab643a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:23.450065 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9acd69cc-1d50-4b87-a831-559328ab643a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:23.457795 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9acd69cc-1d50-4b87-a831-559328ab643a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:23.458648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9acd69cc-1d50-4b87-a831-559328ab643a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:23.459332 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9acd69cc-1d50-4b87-a831-559328ab643a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:23.460523 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9acd69cc-1d50-4b87-a831-559328ab643a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:23.461276 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9acd69cc-1d50-4b87-a831-559328ab643a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:23.462018 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9acd69cc-1d50-4b87-a831-559328ab643a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:23.503109 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9acd69cc-1d50-4b87-a831-559328ab643a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/os-volume_attachments/b8e15517-0f2e-4c18-8182-da06aab1ac3c" status: 200 len: 194 microversion: 2.20 time: 0.058976 Aug 05 20:48:23.503759 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 331/624] 10.222.0.100 () {60 vars in 1459 bytes} [Fri Aug 5 20:48:23 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/os-volume_attachments/b8e15517-0f2e-4c18-8182-da06aab1ac3c => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:48:23.589050 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0f499150-3a48-4f8d-9c19-d1d4a5f97e52 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:23.589852 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0f499150-3a48-4f8d-9c19-d1d4a5f97e52 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:23.599735 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0f499150-3a48-4f8d-9c19-d1d4a5f97e52 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:23.600335 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0f499150-3a48-4f8d-9c19-d1d4a5f97e52 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:23.601033 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0f499150-3a48-4f8d-9c19-d1d4a5f97e52 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:23.602135 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0f499150-3a48-4f8d-9c19-d1d4a5f97e52 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:23.602591 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0f499150-3a48-4f8d-9c19-d1d4a5f97e52 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:23.603025 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0f499150-3a48-4f8d-9c19-d1d4a5f97e52 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:23.617634 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2c9b799d-7105-46a1-a915-64b6967d8188 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:23.618257 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2c9b799d-7105-46a1-a915-64b6967d8188 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:23.625052 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c9b799d-7105-46a1-a915-64b6967d8188 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:23.625612 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c9b799d-7105-46a1-a915-64b6967d8188 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:23.626051 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c9b799d-7105-46a1-a915-64b6967d8188 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:23.626758 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c9b799d-7105-46a1-a915-64b6967d8188 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:23.627226 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c9b799d-7105-46a1-a915-64b6967d8188 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:23.627709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2c9b799d-7105-46a1-a915-64b6967d8188 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:23.702471 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-0f499150-3a48-4f8d-9c19-d1d4a5f97e52 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lazy-loading 'services' on Instance uuid 20537f07-e2b8-4c88-8757-58c0b37570d2 {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:48:23.789249 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0f499150-3a48-4f8d-9c19-d1d4a5f97e52 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "DELETE /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/os-volume_attachments/b8e15517-0f2e-4c18-8182-da06aab1ac3c" status: 202 len: 0 microversion: 2.20 time: 0.205371 Aug 05 20:48:23.790345 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 294/625] 10.222.0.100 () {60 vars in 1462 bytes} [Fri Aug 5 20:48:23 2022] DELETE /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/os-volume_attachments/b8e15517-0f2e-4c18-8182-da06aab1ac3c => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:48:23.793002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2c9b799d-7105-46a1-a915-64b6967d8188 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:23.802080 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-cd657252-75d0-499b-b5fb-d3737fe34a16 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:23.805024 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-cd657252-75d0-499b-b5fb-d3737fe34a16 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:23.812937 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd657252-75d0-499b-b5fb-d3737fe34a16 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:23.813459 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd657252-75d0-499b-b5fb-d3737fe34a16 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:23.813878 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd657252-75d0-499b-b5fb-d3737fe34a16 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:23.814731 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd657252-75d0-499b-b5fb-d3737fe34a16 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:23.815245 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd657252-75d0-499b-b5fb-d3737fe34a16 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:23.815708 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd657252-75d0-499b-b5fb-d3737fe34a16 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:23.825109 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2c9b799d-7105-46a1-a915-64b6967d8188 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1269 microversion: 2.1 time: 0.211536 Aug 05 20:48:23.826151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 332/626] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:23 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1269 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:48:23.860446 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-cd657252-75d0-499b-b5fb-d3737fe34a16 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064609 Aug 05 20:48:23.861316 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 295/627] 10.222.0.100 () {60 vars in 1348 bytes} [Fri Aug 5 20:48:23 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 20:48:23.992403 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-3371d551-265b-467a-9abb-8e97a3934790 req-0445cebe-c5ac-406f-ae48-270db1c1b1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c7ca7c-10a8-4b62-a82e-01b05bd4cf19", "name": "network-vif-plugged", "status": "completed", "tag": "a2fcfeb9-5c68-48c4-8cf9-887f89995b6e"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:24.003527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-3371d551-265b-467a-9abb-8e97a3934790 req-0445cebe-c5ac-406f-ae48-270db1c1b1d0 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:24.004097 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-3371d551-265b-467a-9abb-8e97a3934790 req-0445cebe-c5ac-406f-ae48-270db1c1b1d0 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:24.004575 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-3371d551-265b-467a-9abb-8e97a3934790 req-0445cebe-c5ac-406f-ae48-270db1c1b1d0 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:24.017541 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-3371d551-265b-467a-9abb-8e97a3934790 req-0445cebe-c5ac-406f-ae48-270db1c1b1d0 service nova] Creating event network-vif-plugged:a2fcfeb9-5c68-48c4-8cf9-887f89995b6e for instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 on hv-cinder-85220 Aug 05 20:48:24.022718 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-3371d551-265b-467a-9abb-8e97a3934790 req-0445cebe-c5ac-406f-ae48-270db1c1b1d0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035871 Aug 05 20:48:24.023399 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 333/628] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:48:24.846890 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-de14721f-2851-4866-a267-458f60ed8460 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:24.847513 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-de14721f-2851-4866-a267-458f60ed8460 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:24.854882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-de14721f-2851-4866-a267-458f60ed8460 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:24.855350 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-de14721f-2851-4866-a267-458f60ed8460 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:24.855799 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-de14721f-2851-4866-a267-458f60ed8460 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:24.856491 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-de14721f-2851-4866-a267-458f60ed8460 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:24.856938 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-de14721f-2851-4866-a267-458f60ed8460 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:24.857354 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-de14721f-2851-4866-a267-458f60ed8460 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:24.874395 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fa6301c1-7f34-47e1-9f47-1c9fc93a58e2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:24.876595 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fa6301c1-7f34-47e1-9f47-1c9fc93a58e2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:24.882784 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fa6301c1-7f34-47e1-9f47-1c9fc93a58e2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:24.883268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fa6301c1-7f34-47e1-9f47-1c9fc93a58e2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:24.883727 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fa6301c1-7f34-47e1-9f47-1c9fc93a58e2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:24.884414 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fa6301c1-7f34-47e1-9f47-1c9fc93a58e2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:24.884860 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fa6301c1-7f34-47e1-9f47-1c9fc93a58e2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:24.885311 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fa6301c1-7f34-47e1-9f47-1c9fc93a58e2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:24.915373 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fa6301c1-7f34-47e1-9f47-1c9fc93a58e2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045907 Aug 05 20:48:24.916123 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 334/629] 10.222.0.100 () {60 vars in 1348 bytes} [Fri Aug 5 20:48:24 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:48:25.000766 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-de14721f-2851-4866-a267-458f60ed8460 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:25.009823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-de14721f-2851-4866-a267-458f60ed8460 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1269 microversion: 2.1 time: 0.167201 Aug 05 20:48:25.010403 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 296/630] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:24 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:25.930676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-15adf590-d3be-493b-8e28-03f0ee91dfe4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:25.932884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-15adf590-d3be-493b-8e28-03f0ee91dfe4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:25.940129 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15adf590-d3be-493b-8e28-03f0ee91dfe4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:25.940563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15adf590-d3be-493b-8e28-03f0ee91dfe4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:25.940988 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15adf590-d3be-493b-8e28-03f0ee91dfe4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:25.941988 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15adf590-d3be-493b-8e28-03f0ee91dfe4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:25.942131 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15adf590-d3be-493b-8e28-03f0ee91dfe4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:25.942519 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-15adf590-d3be-493b-8e28-03f0ee91dfe4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:25.973899 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-15adf590-d3be-493b-8e28-03f0ee91dfe4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048856 Aug 05 20:48:25.974473 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 335/631] 10.222.0.100 () {60 vars in 1348 bytes} [Fri Aug 5 20:48:25 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:48:26.031050 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-afe5f836-b843-497c-8e84-6e12e9ea3432 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:26.031732 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-afe5f836-b843-497c-8e84-6e12e9ea3432 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:26.038592 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b063e02f-6454-41c5-bda1-25ee09bd4a24 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:26.039179 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b063e02f-6454-41c5-bda1-25ee09bd4a24 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:26.040497 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-afe5f836-b843-497c-8e84-6e12e9ea3432 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:26.041005 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-afe5f836-b843-497c-8e84-6e12e9ea3432 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:26.041516 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-afe5f836-b843-497c-8e84-6e12e9ea3432 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:26.042226 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-afe5f836-b843-497c-8e84-6e12e9ea3432 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:26.042849 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-afe5f836-b843-497c-8e84-6e12e9ea3432 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:26.043567 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-afe5f836-b843-497c-8e84-6e12e9ea3432 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:26.046034 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b063e02f-6454-41c5-bda1-25ee09bd4a24 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:26.046522 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b063e02f-6454-41c5-bda1-25ee09bd4a24 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:26.046954 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b063e02f-6454-41c5-bda1-25ee09bd4a24 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:26.047673 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b063e02f-6454-41c5-bda1-25ee09bd4a24 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:26.048105 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b063e02f-6454-41c5-bda1-25ee09bd4a24 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:26.048681 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b063e02f-6454-41c5-bda1-25ee09bd4a24 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:26.074843 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b063e02f-6454-41c5-bda1-25ee09bd4a24 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:48:26.099397 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:26.154622 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b063e02f-6454-41c5-bda1-25ee09bd4a24 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "DELETE /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 204 len: 0 microversion: 2.20 time: 0.119878 Aug 05 20:48:26.155318 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 336/632] 10.222.0.100 () {60 vars in 1285 bytes} [Fri Aug 5 20:48:26 2022] DELETE /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 05 20:48:26.164472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-49b394a3-4baf-4615-8563-e7af949df561 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:26.165306 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-49b394a3-4baf-4615-8563-e7af949df561 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:26.171157 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-49b394a3-4baf-4615-8563-e7af949df561 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:26.171674 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-49b394a3-4baf-4615-8563-e7af949df561 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:26.172105 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-49b394a3-4baf-4615-8563-e7af949df561 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:26.172804 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-49b394a3-4baf-4615-8563-e7af949df561 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:26.173271 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-49b394a3-4baf-4615-8563-e7af949df561 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:26.173689 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-49b394a3-4baf-4615-8563-e7af949df561 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:26.185609 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-afe5f836-b843-497c-8e84-6e12e9ea3432 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:26.193445 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-afe5f836-b843-497c-8e84-6e12e9ea3432 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1269 microversion: 2.1 time: 0.166569 Aug 05 20:48:26.193943 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 297/633] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:26 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:26.307248 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-49b394a3-4baf-4615-8563-e7af949df561 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:26.315461 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-49b394a3-4baf-4615-8563-e7af949df561 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:26.316961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-49b394a3-4baf-4615-8563-e7af949df561 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:26.318127 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-49b394a3-4baf-4615-8563-e7af949df561 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1726 microversion: 2.20 time: 0.158189 Aug 05 20:48:26.318695 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 337/634] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:26 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:48:27.215812 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-b6be8bdd-cba0-436b-8e58-1105dc34a245 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:27.216516 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-b6be8bdd-cba0-436b-8e58-1105dc34a245 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:27.224725 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b6be8bdd-cba0-436b-8e58-1105dc34a245 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:27.225223 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b6be8bdd-cba0-436b-8e58-1105dc34a245 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:27.225814 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b6be8bdd-cba0-436b-8e58-1105dc34a245 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:27.226601 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b6be8bdd-cba0-436b-8e58-1105dc34a245 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:27.227065 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b6be8bdd-cba0-436b-8e58-1105dc34a245 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:27.227523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b6be8bdd-cba0-436b-8e58-1105dc34a245 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:27.341385 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ed190245-a162-4daf-bcb2-e500529e1ef7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:27.342018 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ed190245-a162-4daf-bcb2-e500529e1ef7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:27.348987 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ed190245-a162-4daf-bcb2-e500529e1ef7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:27.349481 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ed190245-a162-4daf-bcb2-e500529e1ef7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:27.349917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ed190245-a162-4daf-bcb2-e500529e1ef7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:27.350676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ed190245-a162-4daf-bcb2-e500529e1ef7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:27.351163 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ed190245-a162-4daf-bcb2-e500529e1ef7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:27.351623 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ed190245-a162-4daf-bcb2-e500529e1ef7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:27.385737 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-b6be8bdd-cba0-436b-8e58-1105dc34a245 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:27.393914 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-b6be8bdd-cba0-436b-8e58-1105dc34a245 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1456 microversion: 2.1 time: 0.182878 Aug 05 20:48:27.394502 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 298/635] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:27 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1456 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:27.414753 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3f4a5152-2d12-4c6c-ae45-e65de2c453d7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:27.415642 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3f4a5152-2d12-4c6c-ae45-e65de2c453d7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:27.421935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3f4a5152-2d12-4c6c-ae45-e65de2c453d7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:27.422513 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3f4a5152-2d12-4c6c-ae45-e65de2c453d7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:27.423068 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3f4a5152-2d12-4c6c-ae45-e65de2c453d7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:27.423874 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3f4a5152-2d12-4c6c-ae45-e65de2c453d7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:27.424404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3f4a5152-2d12-4c6c-ae45-e65de2c453d7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:27.424901 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3f4a5152-2d12-4c6c-ae45-e65de2c453d7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:27.508992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ed190245-a162-4daf-bcb2-e500529e1ef7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:27.517515 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ed190245-a162-4daf-bcb2-e500529e1ef7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:27.519031 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ed190245-a162-4daf-bcb2-e500529e1ef7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:27.520234 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ed190245-a162-4daf-bcb2-e500529e1ef7 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1726 microversion: 2.20 time: 0.182966 Aug 05 20:48:27.520806 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 338/636] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:27 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:48:27.577434 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3f4a5152-2d12-4c6c-ae45-e65de2c453d7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:27.588431 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3f4a5152-2d12-4c6c-ae45-e65de2c453d7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1456 microversion: 2.1 time: 0.177640 Aug 05 20:48:27.589055 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 299/637] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:27 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1456 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:28.544724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8b8a870c-4b3d-497e-92db-9c54fe56bc0a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:28.545338 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8b8a870c-4b3d-497e-92db-9c54fe56bc0a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:28.551927 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8b8a870c-4b3d-497e-92db-9c54fe56bc0a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:28.552411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8b8a870c-4b3d-497e-92db-9c54fe56bc0a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:28.552837 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8b8a870c-4b3d-497e-92db-9c54fe56bc0a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:28.553525 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8b8a870c-4b3d-497e-92db-9c54fe56bc0a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:28.554182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8b8a870c-4b3d-497e-92db-9c54fe56bc0a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:28.554901 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8b8a870c-4b3d-497e-92db-9c54fe56bc0a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:28.689458 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8b8a870c-4b3d-497e-92db-9c54fe56bc0a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:28.697872 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8b8a870c-4b3d-497e-92db-9c54fe56bc0a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:28.699396 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8b8a870c-4b3d-497e-92db-9c54fe56bc0a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:28.700567 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8b8a870c-4b3d-497e-92db-9c54fe56bc0a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1726 microversion: 2.20 time: 0.159800 Aug 05 20:48:28.701091 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 339/638] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:28 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:48:29.609554 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-e31f9bbe-4842-44ab-8695-8c4a96e9afc0 req-98d21cdd-bad3-438f-8039-0f96b9b9ca3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c7ca7c-10a8-4b62-a82e-01b05bd4cf19", "tag": "a2fcfeb9-5c68-48c4-8cf9-887f89995b6e"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:29.615784 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:29.621266 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-e31f9bbe-4842-44ab-8695-8c4a96e9afc0 req-98d21cdd-bad3-438f-8039-0f96b9b9ca3f service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:29.621993 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-e31f9bbe-4842-44ab-8695-8c4a96e9afc0 req-98d21cdd-bad3-438f-8039-0f96b9b9ca3f service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:29.622620 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-e31f9bbe-4842-44ab-8695-8c4a96e9afc0 req-98d21cdd-bad3-438f-8039-0f96b9b9ca3f service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:29.636816 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-e31f9bbe-4842-44ab-8695-8c4a96e9afc0 req-98d21cdd-bad3-438f-8039-0f96b9b9ca3f service nova] Creating event network-changed:a2fcfeb9-5c68-48c4-8cf9-887f89995b6e for instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 on hv-cinder-85220 Aug 05 20:48:29.641849 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-e31f9bbe-4842-44ab-8695-8c4a96e9afc0 req-98d21cdd-bad3-438f-8039-0f96b9b9ca3f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036235 Aug 05 20:48:29.642428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 300/639] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:48:29.726953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6896ccd1-22e0-428d-a3b3-c5cc5101acc4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:29.735800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6896ccd1-22e0-428d-a3b3-c5cc5101acc4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:29.745309 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6896ccd1-22e0-428d-a3b3-c5cc5101acc4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:29.745811 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6896ccd1-22e0-428d-a3b3-c5cc5101acc4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:29.746251 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6896ccd1-22e0-428d-a3b3-c5cc5101acc4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:29.746958 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6896ccd1-22e0-428d-a3b3-c5cc5101acc4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:29.752539 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6896ccd1-22e0-428d-a3b3-c5cc5101acc4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:29.753212 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6896ccd1-22e0-428d-a3b3-c5cc5101acc4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:29.784118 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-933f0b1b-d934-411b-9983-5ffcf9a13bb4 req-20fb8df4-dc2c-49c7-9b10-157bf2edbc26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20537f07-e2b8-4c88-8757-58c0b37570d2", "name": "network-vif-deleted", "tag": "a196cd1a-7fd3-4c91-8b4f-d500d0c2740a"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:29.806180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-933f0b1b-d934-411b-9983-5ffcf9a13bb4 req-20fb8df4-dc2c-49c7-9b10-157bf2edbc26 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:29.807151 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-933f0b1b-d934-411b-9983-5ffcf9a13bb4 req-20fb8df4-dc2c-49c7-9b10-157bf2edbc26 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:29.807874 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-933f0b1b-d934-411b-9983-5ffcf9a13bb4 req-20fb8df4-dc2c-49c7-9b10-157bf2edbc26 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:29.831738 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-933f0b1b-d934-411b-9983-5ffcf9a13bb4 req-20fb8df4-dc2c-49c7-9b10-157bf2edbc26 service nova] Creating event network-vif-deleted:a196cd1a-7fd3-4c91-8b4f-d500d0c2740a for instance 20537f07-e2b8-4c88-8757-58c0b37570d2 on hv-cinder-85220 Aug 05 20:48:29.838081 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-933f0b1b-d934-411b-9983-5ffcf9a13bb4 req-20fb8df4-dc2c-49c7-9b10-157bf2edbc26 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058208 Aug 05 20:48:29.839726 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 301/640] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:48:29.902951 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6896ccd1-22e0-428d-a3b3-c5cc5101acc4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:29.915320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6896ccd1-22e0-428d-a3b3-c5cc5101acc4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:29.918844 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6896ccd1-22e0-428d-a3b3-c5cc5101acc4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:29.923710 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6896ccd1-22e0-428d-a3b3-c5cc5101acc4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 200 len: 1659 microversion: 2.20 time: 0.203272 Aug 05 20:48:29.924777 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 340/641] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:29 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 1659 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:48:30.950800 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e9b3e207-deed-47d9-964c-7357ab4d9480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:30.951533 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e9b3e207-deed-47d9-964c-7357ab4d9480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:30.959316 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e9b3e207-deed-47d9-964c-7357ab4d9480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:30.959822 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e9b3e207-deed-47d9-964c-7357ab4d9480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:30.960423 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e9b3e207-deed-47d9-964c-7357ab4d9480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:30.961366 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e9b3e207-deed-47d9-964c-7357ab4d9480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:30.961830 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e9b3e207-deed-47d9-964c-7357ab4d9480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:30.962257 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e9b3e207-deed-47d9-964c-7357ab4d9480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:30.977000 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-e9b3e207-deed-47d9-964c-7357ab4d9480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] HTTP exception thrown: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e9b3e207-deed-47d9-964c-7357ab4d9480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Request method failure captured: Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 HTTP/1.1 Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEbEos-a63yYE10LSxbaZ_GRvUCy-6JJASVZ5x3f_X1bLptZYaYiPBkmkEzRN-MYzWNYpnwiFVJOXeveS6I0YUTfVTpppEonWUed-QlUFlFp861h98w2GS1mHfgZfmRu5w0mGmSkPevFOiV9wvhwaZN0T3LPfyvm6G1WhNbq86EvOc Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: c687166988fc4513a81e536a8f38ca3e Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:48:30.978688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:48:30.980290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_c687166988fc4513a81e536a8f38ca3e", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:48:30.980290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:48:30.980290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: c687166988fc4513a81e536a8f38ca3e Aug 05 20:48:30.980290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:48:30.980290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-AttachVolumeShelveTestJSON-411590550-project Aug 05 20:48:30.980290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:48:30.980290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:48:30.980290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 44ac4775be0244df8fa0ee51a765c03a Aug 05 20:48:30.980290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-AttachVolumeShelveTestJSON-411590550-project Aug 05 20:48:30.980290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:48:30.980290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:48:30.980290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '20537f07-e2b8-4c88-8757-58c0b37570d2'} Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:48:30.984045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:48:30.985357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:48:30.986589 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e9b3e207-deed-47d9-964c-7357ab4d9480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Returning 404 to user: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:48:30.986589 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e9b3e207-deed-47d9-964c-7357ab4d9480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 404 len: 111 microversion: 2.20 time: 0.033637 Aug 05 20:48:30.986589 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 302/642] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:30 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:48:30.989650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8e084fff-c2a7-4082-b8a7-2a7e7700f31a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '.version_select at 0x7f9be774bf70>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:31.012180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8e084fff-c2a7-4082-b8a7-2a7e7700f31a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-499650073" status: 204 len: 0 microversion: 2.20 time: 0.026468 Aug 05 20:48:31.012883 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 341/643] 10.222.0.100 () {60 vars in 1264 bytes} [Fri Aug 5 20:48:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-499650073 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 20:48:31.667157 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-36cf12dc-1db4-48bc-81d2-88814fa47e24 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Action: 'create', calling method: .version_select at 0x7f9be763cd30>, body: {"keypair": {"name": "tempest-keypair-462310245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGUy1sU3EYtRYyG1/O5NC/MUHJ8+6mhIwh6lFTEDLtjWIY/s7IZJed9QXiH2DBDvFj58sVK5YD2ObQKnOVBMdp8caemwV2sc84D2YxoqXuIrkxXZnWkcGvD8omMm4EDVw=="}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:31.686696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-36cf12dc-1db4-48bc-81d2-88814fa47e24 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Getting quotas for project c687166988fc4513a81e536a8f38ca3e. Resources: {'key_pairs'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:48:31.692516 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-36cf12dc-1db4-48bc-81d2-88814fa47e24 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Getting quotas for user 44ac4775be0244df8fa0ee51a765c03a and project c687166988fc4513a81e536a8f38ca3e. Resources: {'key_pairs'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:48:31.717456 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-36cf12dc-1db4-48bc-81d2-88814fa47e24 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.055011 Aug 05 20:48:31.718058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 303/644] 10.222.0.100 () {62 vars in 1205 bytes} [Fri Aug 5 20:48:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 20:48:33.073897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-742292868", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d117834c-4f6c-451a-85e5-111d70dc09dc"}], "security_groups": [{"name": "tempest-securitygroup--271392088"}], "key_name": "tempest-keypair-462310245", "user_data": "}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:33.189853 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] validate_networks() for [('d117834c-4f6c-451a-85e5-111d70dc09dc', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:48:33.848484 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:48:33.849115 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:48:33.849913 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:48:33.850669 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:48:33.851167 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:48:33.860580 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:33.861068 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:33.861506 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:33.862208 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:33.862687 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:33.863111 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:33.880470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Getting quotas for project c687166988fc4513a81e536a8f38ca3e. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:48:33.885226 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Getting quotas for user 44ac4775be0244df8fa0ee51a765c03a and project c687166988fc4513a81e536a8f38ca3e. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:48:33.897268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:48:33.899605 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:48:33.955578 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-89198a86-252f-4d8c-9ea4-28c8e686401c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 0.888444 Aug 05 20:48:33.956219 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 342/645] 10.222.0.100 () {62 vars in 1193 bytes} [Fri Aug 5 20:48:33 2022] POST /compute/v2.1/servers => generated 403 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 05 20:48:33.969373 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-5d515921-c67d-4839-9106-bbbb6d22037a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:33.969932 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-5d515921-c67d-4839-9106-bbbb6d22037a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:34.025665 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-5d515921-c67d-4839-9106-bbbb6d22037a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:34.033336 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-5d515921-c67d-4839-9106-bbbb6d22037a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:34.034860 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-5d515921-c67d-4839-9106-bbbb6d22037a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:34.036003 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-5d515921-c67d-4839-9106-bbbb6d22037a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1284 microversion: 2.20 time: 0.070701 Aug 05 20:48:34.036572 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 304/646] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:33 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1284 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:48:35.059131 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3d7f2de6-57ef-4637-aa18-718e9f8f201a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:35.059814 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3d7f2de6-57ef-4637-aa18-718e9f8f201a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:35.066542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d7f2de6-57ef-4637-aa18-718e9f8f201a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:35.067025 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d7f2de6-57ef-4637-aa18-718e9f8f201a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:35.067457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d7f2de6-57ef-4637-aa18-718e9f8f201a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:35.068169 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d7f2de6-57ef-4637-aa18-718e9f8f201a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:35.068625 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d7f2de6-57ef-4637-aa18-718e9f8f201a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:35.069067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3d7f2de6-57ef-4637-aa18-718e9f8f201a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:35.138674 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3d7f2de6-57ef-4637-aa18-718e9f8f201a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:35.148105 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3d7f2de6-57ef-4637-aa18-718e9f8f201a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:35.149680 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3d7f2de6-57ef-4637-aa18-718e9f8f201a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:35.150816 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3d7f2de6-57ef-4637-aa18-718e9f8f201a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1336 microversion: 2.20 time: 0.096183 Aug 05 20:48:35.151609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 343/647] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:35 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1336 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:48:36.175290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d7b8c880-c9b8-49b1-8380-47ccafdf4835 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:36.175897 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d7b8c880-c9b8-49b1-8380-47ccafdf4835 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:36.183311 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d7b8c880-c9b8-49b1-8380-47ccafdf4835 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:36.183830 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d7b8c880-c9b8-49b1-8380-47ccafdf4835 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:36.184263 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d7b8c880-c9b8-49b1-8380-47ccafdf4835 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:36.184964 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d7b8c880-c9b8-49b1-8380-47ccafdf4835 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:36.185554 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d7b8c880-c9b8-49b1-8380-47ccafdf4835 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:36.185980 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d7b8c880-c9b8-49b1-8380-47ccafdf4835 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:36.322559 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d7b8c880-c9b8-49b1-8380-47ccafdf4835 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:36.330965 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d7b8c880-c9b8-49b1-8380-47ccafdf4835 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:36.332543 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d7b8c880-c9b8-49b1-8380-47ccafdf4835 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:36.333714 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d7b8c880-c9b8-49b1-8380-47ccafdf4835 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1409 microversion: 2.20 time: 0.163641 Aug 05 20:48:36.334388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 305/648] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:36 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1409 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:48:36.559983 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-d36832a3-a677-44d3-b004-297d915671d6 req-cee05940-b36e-4e00-854e-2c2f45120fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe498615-6695-4746-89be-48a9e31f6b4d", "tag": "5596f6df-3385-436f-9183-b31838466a7c"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:36.571564 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-d36832a3-a677-44d3-b004-297d915671d6 req-cee05940-b36e-4e00-854e-2c2f45120fc4 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:36.572039 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-d36832a3-a677-44d3-b004-297d915671d6 req-cee05940-b36e-4e00-854e-2c2f45120fc4 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:36.572565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-d36832a3-a677-44d3-b004-297d915671d6 req-cee05940-b36e-4e00-854e-2c2f45120fc4 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:36.583967 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-d36832a3-a677-44d3-b004-297d915671d6 req-cee05940-b36e-4e00-854e-2c2f45120fc4 service nova] Creating event network-changed:5596f6df-3385-436f-9183-b31838466a7c for instance fe498615-6695-4746-89be-48a9e31f6b4d on hv-cinder-85220 Aug 05 20:48:36.589481 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-d36832a3-a677-44d3-b004-297d915671d6 req-cee05940-b36e-4e00-854e-2c2f45120fc4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033403 Aug 05 20:48:36.590085 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 344/649] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:48:37.359562 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7be3b9ba-cb6e-47c5-a49d-503fefbac980 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:37.360296 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-7be3b9ba-cb6e-47c5-a49d-503fefbac980 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:37.368690 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7be3b9ba-cb6e-47c5-a49d-503fefbac980 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:37.369182 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7be3b9ba-cb6e-47c5-a49d-503fefbac980 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:37.369621 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7be3b9ba-cb6e-47c5-a49d-503fefbac980 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:37.370318 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7be3b9ba-cb6e-47c5-a49d-503fefbac980 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:37.370778 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7be3b9ba-cb6e-47c5-a49d-503fefbac980 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:37.371202 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7be3b9ba-cb6e-47c5-a49d-503fefbac980 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:37.516856 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7be3b9ba-cb6e-47c5-a49d-503fefbac980 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:37.525220 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7be3b9ba-cb6e-47c5-a49d-503fefbac980 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:37.526750 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7be3b9ba-cb6e-47c5-a49d-503fefbac980 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:37.527901 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-7be3b9ba-cb6e-47c5-a49d-503fefbac980 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1409 microversion: 2.20 time: 0.173887 Aug 05 20:48:37.528766 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 306/650] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:37 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1409 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:48:38.556029 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-bf9840ad-ed43-4433-b97d-b5e90d1b98a2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:38.556608 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-bf9840ad-ed43-4433-b97d-b5e90d1b98a2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:38.563694 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bf9840ad-ed43-4433-b97d-b5e90d1b98a2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:38.564283 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bf9840ad-ed43-4433-b97d-b5e90d1b98a2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:38.564907 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bf9840ad-ed43-4433-b97d-b5e90d1b98a2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:38.565609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bf9840ad-ed43-4433-b97d-b5e90d1b98a2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:38.566045 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bf9840ad-ed43-4433-b97d-b5e90d1b98a2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:38.566685 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-bf9840ad-ed43-4433-b97d-b5e90d1b98a2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:38.700877 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-bf9840ad-ed43-4433-b97d-b5e90d1b98a2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:38.709210 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-bf9840ad-ed43-4433-b97d-b5e90d1b98a2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:38.710941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-bf9840ad-ed43-4433-b97d-b5e90d1b98a2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:38.712109 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-bf9840ad-ed43-4433-b97d-b5e90d1b98a2 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1409 microversion: 2.20 time: 0.161628 Aug 05 20:48:38.712671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 345/651] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:38 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1409 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:48:39.738046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a0f64fc3-aa9a-43f1-9eed-e5e5ec22144c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:39.738633 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a0f64fc3-aa9a-43f1-9eed-e5e5ec22144c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:39.747098 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a0f64fc3-aa9a-43f1-9eed-e5e5ec22144c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:39.747634 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a0f64fc3-aa9a-43f1-9eed-e5e5ec22144c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:39.748077 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a0f64fc3-aa9a-43f1-9eed-e5e5ec22144c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:39.748776 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a0f64fc3-aa9a-43f1-9eed-e5e5ec22144c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:39.749236 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a0f64fc3-aa9a-43f1-9eed-e5e5ec22144c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:39.749692 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a0f64fc3-aa9a-43f1-9eed-e5e5ec22144c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:39.904852 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a0f64fc3-aa9a-43f1-9eed-e5e5ec22144c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:39.914225 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a0f64fc3-aa9a-43f1-9eed-e5e5ec22144c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:39.915754 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a0f64fc3-aa9a-43f1-9eed-e5e5ec22144c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:39.916908 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a0f64fc3-aa9a-43f1-9eed-e5e5ec22144c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1409 microversion: 2.20 time: 0.184806 Aug 05 20:48:39.917467 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 307/652] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:39 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1409 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:48:40.943734 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3fe8d8d9-1f31-4032-963c-525118320e6b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:40.944410 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3fe8d8d9-1f31-4032-963c-525118320e6b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:40.954588 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3fe8d8d9-1f31-4032-963c-525118320e6b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:40.955341 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3fe8d8d9-1f31-4032-963c-525118320e6b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:40.956038 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3fe8d8d9-1f31-4032-963c-525118320e6b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:40.957156 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3fe8d8d9-1f31-4032-963c-525118320e6b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:40.957775 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3fe8d8d9-1f31-4032-963c-525118320e6b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:40.958436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3fe8d8d9-1f31-4032-963c-525118320e6b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:41.109920 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3fe8d8d9-1f31-4032-963c-525118320e6b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:41.118407 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3fe8d8d9-1f31-4032-963c-525118320e6b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:41.119963 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3fe8d8d9-1f31-4032-963c-525118320e6b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:41.121086 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3fe8d8d9-1f31-4032-963c-525118320e6b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1409 microversion: 2.20 time: 0.183920 Aug 05 20:48:41.121908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 346/653] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:40 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1409 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:48:42.064544 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-a55cfd1a-047c-40d8-979c-550ac5dcfa7f req-c3bd67f1-c35d-43fc-90f9-843432720a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe498615-6695-4746-89be-48a9e31f6b4d", "name": "network-vif-plugged", "status": "completed", "tag": "5596f6df-3385-436f-9183-b31838466a7c"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:42.075590 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-a55cfd1a-047c-40d8-979c-550ac5dcfa7f req-c3bd67f1-c35d-43fc-90f9-843432720a8a service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:42.076210 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-a55cfd1a-047c-40d8-979c-550ac5dcfa7f req-c3bd67f1-c35d-43fc-90f9-843432720a8a service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:42.076689 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-a55cfd1a-047c-40d8-979c-550ac5dcfa7f req-c3bd67f1-c35d-43fc-90f9-843432720a8a service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:42.091441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-a55cfd1a-047c-40d8-979c-550ac5dcfa7f req-c3bd67f1-c35d-43fc-90f9-843432720a8a service nova] Creating event network-vif-plugged:5596f6df-3385-436f-9183-b31838466a7c for instance fe498615-6695-4746-89be-48a9e31f6b4d on hv-cinder-85220 Aug 05 20:48:42.096486 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-a55cfd1a-047c-40d8-979c-550ac5dcfa7f req-c3bd67f1-c35d-43fc-90f9-843432720a8a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035722 Aug 05 20:48:42.097293 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 308/654] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:48:42.144338 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a8917b69-4558-45b7-98bc-00611e805297 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:42.144952 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a8917b69-4558-45b7-98bc-00611e805297 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:42.148106 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:42.155106 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8917b69-4558-45b7-98bc-00611e805297 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:42.155872 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8917b69-4558-45b7-98bc-00611e805297 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:42.156471 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8917b69-4558-45b7-98bc-00611e805297 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:42.157348 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8917b69-4558-45b7-98bc-00611e805297 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:42.157817 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8917b69-4558-45b7-98bc-00611e805297 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:42.158262 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8917b69-4558-45b7-98bc-00611e805297 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:42.299373 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a8917b69-4558-45b7-98bc-00611e805297 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:42.307776 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a8917b69-4558-45b7-98bc-00611e805297 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:42.309306 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a8917b69-4558-45b7-98bc-00611e805297 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:42.310437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a8917b69-4558-45b7-98bc-00611e805297 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1409 microversion: 2.20 time: 0.170375 Aug 05 20:48:42.311002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 347/655] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:42 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:48:43.336614 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-49dddb14-9cac-4292-b659-958f18a8cc14 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:43.337285 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-49dddb14-9cac-4292-b659-958f18a8cc14 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:43.344735 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-49dddb14-9cac-4292-b659-958f18a8cc14 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:43.345242 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-49dddb14-9cac-4292-b659-958f18a8cc14 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:43.345706 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-49dddb14-9cac-4292-b659-958f18a8cc14 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:43.346432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-49dddb14-9cac-4292-b659-958f18a8cc14 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:43.346905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-49dddb14-9cac-4292-b659-958f18a8cc14 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:43.347374 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-49dddb14-9cac-4292-b659-958f18a8cc14 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:43.482807 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-49dddb14-9cac-4292-b659-958f18a8cc14 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:43.491410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-49dddb14-9cac-4292-b659-958f18a8cc14 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:43.492921 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-49dddb14-9cac-4292-b659-958f18a8cc14 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:43.494040 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-49dddb14-9cac-4292-b659-958f18a8cc14 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1409 microversion: 2.20 time: 0.163830 Aug 05 20:48:43.494605 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 309/656] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:43 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1409 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:48:44.516928 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f6b14af4-3721-4446-a5fa-6729ad05a2df tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:44.517514 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f6b14af4-3721-4446-a5fa-6729ad05a2df tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:44.519933 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:44.520591 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:44.526997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f6b14af4-3721-4446-a5fa-6729ad05a2df tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:44.527445 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f6b14af4-3721-4446-a5fa-6729ad05a2df tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:44.527878 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f6b14af4-3721-4446-a5fa-6729ad05a2df tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:44.528891 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f6b14af4-3721-4446-a5fa-6729ad05a2df tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:44.529343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f6b14af4-3721-4446-a5fa-6729ad05a2df tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:44.529771 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f6b14af4-3721-4446-a5fa-6729ad05a2df tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:44.671076 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f6b14af4-3721-4446-a5fa-6729ad05a2df tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:44.679645 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f6b14af4-3721-4446-a5fa-6729ad05a2df tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:44.681191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f6b14af4-3721-4446-a5fa-6729ad05a2df tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:44.682416 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f6b14af4-3721-4446-a5fa-6729ad05a2df tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1602 microversion: 2.20 time: 0.169457 Aug 05 20:48:44.682986 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 348/657] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:48:44 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1602 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:48:44.705199 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-872efb32-d825-4c55-9805-2df6e5a9c2f1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:44.705718 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-872efb32-d825-4c55-9805-2df6e5a9c2f1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:44.707853 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=6 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:44.714020 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-872efb32-d825-4c55-9805-2df6e5a9c2f1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:44.714492 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-872efb32-d825-4c55-9805-2df6e5a9c2f1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:44.714929 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-872efb32-d825-4c55-9805-2df6e5a9c2f1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:44.715653 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-872efb32-d825-4c55-9805-2df6e5a9c2f1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:44.716112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-872efb32-d825-4c55-9805-2df6e5a9c2f1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:44.716541 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-872efb32-d825-4c55-9805-2df6e5a9c2f1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:44.804630 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-872efb32-d825-4c55-9805-2df6e5a9c2f1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103112 Aug 05 20:48:44.805251 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 310/658] 10.222.0.100 () {60 vars in 1321 bytes} [Fri Aug 5 20:48:44 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:48:45.789943 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-3cb67229-feb9-4116-8964-9e11aebef6f6 req-bf854973-c9ee-44ef-b282-795068100eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe498615-6695-4746-89be-48a9e31f6b4d", "tag": "5596f6df-3385-436f-9183-b31838466a7c"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:45.800535 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-3cb67229-feb9-4116-8964-9e11aebef6f6 req-bf854973-c9ee-44ef-b282-795068100eb9 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:45.801191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-3cb67229-feb9-4116-8964-9e11aebef6f6 req-bf854973-c9ee-44ef-b282-795068100eb9 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:45.801621 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-3cb67229-feb9-4116-8964-9e11aebef6f6 req-bf854973-c9ee-44ef-b282-795068100eb9 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:45.813352 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-3cb67229-feb9-4116-8964-9e11aebef6f6 req-bf854973-c9ee-44ef-b282-795068100eb9 service nova] Creating event network-changed:5596f6df-3385-436f-9183-b31838466a7c for instance fe498615-6695-4746-89be-48a9e31f6b4d on hv-cinder-85220 Aug 05 20:48:45.818405 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-3cb67229-feb9-4116-8964-9e11aebef6f6 req-bf854973-c9ee-44ef-b282-795068100eb9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032649 Aug 05 20:48:45.819408 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 349/659] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:48:51.997241 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e4734572-066b-4c3e-afc4-e80c1e299cf7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce3bbd68-ce90-45c7-8930-427ba6217cbc"}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:52.000731 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e4734572-066b-4c3e-afc4-e80c1e299cf7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:52.008805 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e4734572-066b-4c3e-afc4-e80c1e299cf7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:52.009297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e4734572-066b-4c3e-afc4-e80c1e299cf7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:52.009737 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e4734572-066b-4c3e-afc4-e80c1e299cf7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:52.010435 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e4734572-066b-4c3e-afc4-e80c1e299cf7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:52.010888 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e4734572-066b-4c3e-afc4-e80c1e299cf7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:52.011316 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e4734572-066b-4c3e-afc4-e80c1e299cf7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:52.304172 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e4734572-066b-4c3e-afc4-e80c1e299cf7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "POST /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314311 Aug 05 20:48:52.305155 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 311/660] 10.222.0.100 () {60 vars in 1328 bytes} [Fri Aug 5 20:48:51 2022] POST /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:48:55.672641 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ddeeab8c-c51c-41c9-b950-e10c8056f813 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:55.674869 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ddeeab8c-c51c-41c9-b950-e10c8056f813 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:55.681309 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ddeeab8c-c51c-41c9-b950-e10c8056f813 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:55.681797 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ddeeab8c-c51c-41c9-b950-e10c8056f813 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:55.682233 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ddeeab8c-c51c-41c9-b950-e10c8056f813 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:55.682925 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ddeeab8c-c51c-41c9-b950-e10c8056f813 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:55.683387 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ddeeab8c-c51c-41c9-b950-e10c8056f813 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:55.683839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ddeeab8c-c51c-41c9-b950-e10c8056f813 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:55.712796 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ddeeab8c-c51c-41c9-b950-e10c8056f813 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045174 Aug 05 20:48:55.713338 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 350/661] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:48:55 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:48:55.785196 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-70e0c2a0-7c02-4d97-b358-284dcbfc6c94 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:55.786192 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-70e0c2a0-7c02-4d97-b358-284dcbfc6c94 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:55.793995 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-70e0c2a0-7c02-4d97-b358-284dcbfc6c94 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:55.794499 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-70e0c2a0-7c02-4d97-b358-284dcbfc6c94 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:55.794935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-70e0c2a0-7c02-4d97-b358-284dcbfc6c94 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:55.795673 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-70e0c2a0-7c02-4d97-b358-284dcbfc6c94 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:55.796125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-70e0c2a0-7c02-4d97-b358-284dcbfc6c94 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:55.796551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-70e0c2a0-7c02-4d97-b358-284dcbfc6c94 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:55.799273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:55.825512 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-70e0c2a0-7c02-4d97-b358-284dcbfc6c94 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Going to try to terminate instance {{(pid=124431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:48:55.918739 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-70e0c2a0-7c02-4d97-b358-284dcbfc6c94 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "DELETE /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 204 len: 0 microversion: 2.1 time: 0.140282 Aug 05 20:48:55.919379 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 312/662] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:48:55 2022] DELETE /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:48:55.928154 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ac12b2d3-75a1-4f0d-8b09-ef133ea87f91 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:55.929002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ac12b2d3-75a1-4f0d-8b09-ef133ea87f91 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:55.935552 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac12b2d3-75a1-4f0d-8b09-ef133ea87f91 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:55.936092 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac12b2d3-75a1-4f0d-8b09-ef133ea87f91 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:55.936534 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac12b2d3-75a1-4f0d-8b09-ef133ea87f91 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:55.937258 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac12b2d3-75a1-4f0d-8b09-ef133ea87f91 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:55.937717 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac12b2d3-75a1-4f0d-8b09-ef133ea87f91 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:55.938147 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ac12b2d3-75a1-4f0d-8b09-ef133ea87f91 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:56.144918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ac12b2d3-75a1-4f0d-8b09-ef133ea87f91 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:56.147908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:56.155593 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ac12b2d3-75a1-4f0d-8b09-ef133ea87f91 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1676 microversion: 2.1 time: 0.231750 Aug 05 20:48:56.156160 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 351/663] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:55 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1676 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:57.182870 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-34dfc920-3811-4c8e-bdca-57124575097c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:57.184158 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-34dfc920-3811-4c8e-bdca-57124575097c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:57.194846 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-34dfc920-3811-4c8e-bdca-57124575097c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:57.195339 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-34dfc920-3811-4c8e-bdca-57124575097c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:57.195812 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-34dfc920-3811-4c8e-bdca-57124575097c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:57.196510 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-34dfc920-3811-4c8e-bdca-57124575097c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:57.196987 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-34dfc920-3811-4c8e-bdca-57124575097c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:57.197420 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-34dfc920-3811-4c8e-bdca-57124575097c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:57.403402 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-34dfc920-3811-4c8e-bdca-57124575097c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:57.411611 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-34dfc920-3811-4c8e-bdca-57124575097c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1676 microversion: 2.1 time: 0.236596 Aug 05 20:48:57.412246 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 313/664] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:57 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:58.436207 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a3356e21-d366-404f-88f7-8aa2ed2e1718 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:58.436804 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a3356e21-d366-404f-88f7-8aa2ed2e1718 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:58.444166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a3356e21-d366-404f-88f7-8aa2ed2e1718 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:58.444685 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a3356e21-d366-404f-88f7-8aa2ed2e1718 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:58.445119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a3356e21-d366-404f-88f7-8aa2ed2e1718 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:58.445816 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a3356e21-d366-404f-88f7-8aa2ed2e1718 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:58.446272 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a3356e21-d366-404f-88f7-8aa2ed2e1718 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:58.446699 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a3356e21-d366-404f-88f7-8aa2ed2e1718 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:58.605179 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a3356e21-d366-404f-88f7-8aa2ed2e1718 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:58.618029 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a3356e21-d366-404f-88f7-8aa2ed2e1718 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1676 microversion: 2.1 time: 0.186344 Aug 05 20:48:58.618920 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 352/665] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:58 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:59.645457 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a2e06bea-64d9-42e4-8e2b-9608bb142235 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:48:59.646008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a2e06bea-64d9-42e4-8e2b-9608bb142235 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:59.648793 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:48:59.655232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a2e06bea-64d9-42e4-8e2b-9608bb142235 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:59.655776 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a2e06bea-64d9-42e4-8e2b-9608bb142235 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:59.656213 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a2e06bea-64d9-42e4-8e2b-9608bb142235 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:59.656938 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a2e06bea-64d9-42e4-8e2b-9608bb142235 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:59.657392 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a2e06bea-64d9-42e4-8e2b-9608bb142235 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:59.657844 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a2e06bea-64d9-42e4-8e2b-9608bb142235 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:59.803530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a2e06bea-64d9-42e4-8e2b-9608bb142235 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:48:59.812310 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a2e06bea-64d9-42e4-8e2b-9608bb142235 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1676 microversion: 2.1 time: 0.170852 Aug 05 20:48:59.813098 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 314/666] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:48:59 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:48:59.899957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-54c163ad-2e55-4a2b-883e-df0d6af7b0b6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:48:59.902074 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-54c163ad-2e55-4a2b-883e-df0d6af7b0b6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:48:59.908755 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-54c163ad-2e55-4a2b-883e-df0d6af7b0b6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:59.909270 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-54c163ad-2e55-4a2b-883e-df0d6af7b0b6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:59.909747 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-54c163ad-2e55-4a2b-883e-df0d6af7b0b6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:59.910439 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-54c163ad-2e55-4a2b-883e-df0d6af7b0b6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:48:59.910943 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-54c163ad-2e55-4a2b-883e-df0d6af7b0b6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:48:59.911346 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-54c163ad-2e55-4a2b-883e-df0d6af7b0b6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:48:59.937464 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-54c163ad-2e55-4a2b-883e-df0d6af7b0b6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lazy-loading 'flavor' on Instance uuid c34d5df9-1498-4fdd-a688-5d8bad899a6f {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:49:00.076924 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-54c163ad-2e55-4a2b-883e-df0d6af7b0b6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "POST /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/action" status: 200 len: 32 microversion: 2.1 time: 0.181027 Aug 05 20:49:00.078086 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 353/667] 10.222.0.100 () {60 vars in 1283 bytes} [Fri Aug 5 20:48:59 2022] POST /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:49:00.089581 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e8f0f1e2-24a0-4f16-9d35-5379b7c2969e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:00.090241 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e8f0f1e2-24a0-4f16-9d35-5379b7c2969e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:00.100163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e8f0f1e2-24a0-4f16-9d35-5379b7c2969e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:00.101020 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e8f0f1e2-24a0-4f16-9d35-5379b7c2969e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:00.101463 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e8f0f1e2-24a0-4f16-9d35-5379b7c2969e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:00.102196 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e8f0f1e2-24a0-4f16-9d35-5379b7c2969e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:00.102808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e8f0f1e2-24a0-4f16-9d35-5379b7c2969e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:00.103249 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e8f0f1e2-24a0-4f16-9d35-5379b7c2969e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:00.323636 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-7cf2089e-0b1d-44db-9d22-87f9024f0a27 req-868db3ce-ec46-437c-a88e-022d99cfa27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39afe8dc-01f2-4947-b48c-ac9664fb46cd", "name": "network-vif-deleted", "tag": "34a70542-760a-48dc-85b0-7ef5bbff6348"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:00.331597 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-e8f0f1e2-24a0-4f16-9d35-5379b7c2969e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:00.342242 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e8f0f1e2-24a0-4f16-9d35-5379b7c2969e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.258756 Aug 05 20:49:00.355454 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 315/668] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:00 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:00.363454 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-7cf2089e-0b1d-44db-9d22-87f9024f0a27 req-868db3ce-ec46-437c-a88e-022d99cfa27f service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:00.363943 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-7cf2089e-0b1d-44db-9d22-87f9024f0a27 req-868db3ce-ec46-437c-a88e-022d99cfa27f service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:00.364374 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-7cf2089e-0b1d-44db-9d22-87f9024f0a27 req-868db3ce-ec46-437c-a88e-022d99cfa27f service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:00.393104 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-7cf2089e-0b1d-44db-9d22-87f9024f0a27 req-868db3ce-ec46-437c-a88e-022d99cfa27f service nova] Creating event network-vif-deleted:34a70542-760a-48dc-85b0-7ef5bbff6348 for instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd on hv-cinder-85220 Aug 05 20:49:00.398155 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-7cf2089e-0b1d-44db-9d22-87f9024f0a27 req-868db3ce-ec46-437c-a88e-022d99cfa27f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080745 Aug 05 20:49:00.402031 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 354/669] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:49:00.833967 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-00335923-da27-4b46-a855-bbe5212cd72e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:00.834701 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-00335923-da27-4b46-a855-bbe5212cd72e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:00.842011 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-00335923-da27-4b46-a855-bbe5212cd72e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:00.842525 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-00335923-da27-4b46-a855-bbe5212cd72e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:00.842966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-00335923-da27-4b46-a855-bbe5212cd72e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:00.843700 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-00335923-da27-4b46-a855-bbe5212cd72e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:00.844164 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-00335923-da27-4b46-a855-bbe5212cd72e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:00.844622 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-00335923-da27-4b46-a855-bbe5212cd72e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:00.877775 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-00335923-da27-4b46-a855-bbe5212cd72e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:00.878252 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-00335923-da27-4b46-a855-bbe5212cd72e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:00.878692 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-00335923-da27-4b46-a855-bbe5212cd72e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:00.879135 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-00335923-da27-4b46-a855-bbe5212cd72e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lazy-loading 'fault' on Instance uuid 39afe8dc-01f2-4947-b48c-ac9664fb46cd {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:49:00.990314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-00335923-da27-4b46-a855-bbe5212cd72e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:00.999058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-00335923-da27-4b46-a855-bbe5212cd72e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 200 len: 1331 microversion: 2.1 time: 0.169564 Aug 05 20:49:01.012631 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 316/670] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:00 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 1331 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:01.366641 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3bca2f3f-b9c9-424b-9aa1-3de399c49874 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:01.367401 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3bca2f3f-b9c9-424b-9aa1-3de399c49874 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:01.374475 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3bca2f3f-b9c9-424b-9aa1-3de399c49874 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:01.374996 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3bca2f3f-b9c9-424b-9aa1-3de399c49874 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:01.375462 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3bca2f3f-b9c9-424b-9aa1-3de399c49874 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:01.376191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3bca2f3f-b9c9-424b-9aa1-3de399c49874 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:01.376647 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3bca2f3f-b9c9-424b-9aa1-3de399c49874 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:01.377073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3bca2f3f-b9c9-424b-9aa1-3de399c49874 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:01.513751 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3bca2f3f-b9c9-424b-9aa1-3de399c49874 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:01.526918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3bca2f3f-b9c9-424b-9aa1-3de399c49874 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.164913 Aug 05 20:49:01.528138 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 355/671] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:01 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:02.021530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ef686c08-6066-45c9-95d7-5ea9b6505c6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:02.022138 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ef686c08-6066-45c9-95d7-5ea9b6505c6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:02.030445 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef686c08-6066-45c9-95d7-5ea9b6505c6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:02.030936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef686c08-6066-45c9-95d7-5ea9b6505c6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:02.031388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef686c08-6066-45c9-95d7-5ea9b6505c6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:02.032107 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef686c08-6066-45c9-95d7-5ea9b6505c6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:02.032561 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef686c08-6066-45c9-95d7-5ea9b6505c6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:02.032991 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef686c08-6066-45c9-95d7-5ea9b6505c6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:02.047997 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-ef686c08-6066-45c9-95d7-5ea9b6505c6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] HTTP exception thrown: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ef686c08-6066-45c9-95d7-5ea9b6505c6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Request method failure captured: Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd HTTP/1.1 Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEXspSy7q1zy4V9Cv4aRjZ03fZpiLNmcRvWN6KVoc09VMqrJcz58m2sy75emj-7EcDSb3hAjyBesDI93PKpt5EBFfPqLmGvPDhB5mO2IRQ6FL-vUjtGnRYiVrh_KI_n6qQumKkNVwxY2tokLdVj7j-H0EthC5kOK1UwqZTHvtjW1gs Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 2ae12b8f8a7f40758ca0edaeea7022ab Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:49:02.049680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:49:02.051232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2ae12b8f8a7f40758ca0edaeea7022ab", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:49:02.051232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:49:02.051232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 2ae12b8f8a7f40758ca0edaeea7022ab Aug 05 20:49:02.051232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:49:02.051232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-AttachVolumeTestJSON-1543654885-project Aug 05 20:49:02.051232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:49:02.051232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:49:02.051232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 396a79cbb4e9494791422713c596bc0c Aug 05 20:49:02.051232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-AttachVolumeTestJSON-1543654885-project Aug 05 20:49:02.051232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:49:02.051232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:49:02.051232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '39afe8dc-01f2-4947-b48c-ac9664fb46cd'} Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:49:02.052103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:49:02.053619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:49:02.054960 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ef686c08-6066-45c9-95d7-5ea9b6505c6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Returning 404 to user: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:49:02.054960 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ef686c08-6066-45c9-95d7-5ea9b6505c6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 404 len: 111 microversion: 2.1 time: 0.033526 Aug 05 20:49:02.054960 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 317/672] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:02 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:49:02.060447 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4087f0ae-8fe4-464a-9775-eda71fd72799 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '.version_select at 0x7f9be7754dc0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:02.081951 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4087f0ae-8fe4-464a-9775-eda71fd72799 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-205549469" status: 202 len: 0 microversion: 2.1 time: 0.025392 Aug 05 20:49:02.082509 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 356/673] 10.222.0.100 () {58 vars in 1223 bytes} [Fri Aug 5 20:49:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-205549469 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:49:02.549418 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-51847647-60ae-46e9-87af-2ed72d7150c7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:02.550187 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-51847647-60ae-46e9-87af-2ed72d7150c7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:02.557846 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-51847647-60ae-46e9-87af-2ed72d7150c7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:02.558513 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-51847647-60ae-46e9-87af-2ed72d7150c7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:02.559116 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-51847647-60ae-46e9-87af-2ed72d7150c7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:02.560309 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-51847647-60ae-46e9-87af-2ed72d7150c7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:02.560959 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-51847647-60ae-46e9-87af-2ed72d7150c7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:02.561540 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-51847647-60ae-46e9-87af-2ed72d7150c7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:02.808814 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-51847647-60ae-46e9-87af-2ed72d7150c7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:02.817918 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-51847647-60ae-46e9-87af-2ed72d7150c7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.272547 Aug 05 20:49:02.818333 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 318/674] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:02 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:02.846452 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-36a49e45-b6d5-41c6-ba7b-5878ef5e3fed tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Action: 'create', calling method: .version_select at 0x7f9be772b1f0>, body: {"keypair": {"name": "tempest-keypair-1497565594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLq4v6Jx5xAE1xntnvcWqlHT/X2Cl9WfZ4eQxALqUG/Cf0th38mtvzTD5kaX3PASwjPQJ8UkqJeHoptPt52mBp3vTXKhQ4yEYZ8HEu96AHk4EgLms/v4stdCKlvblCRdug=="}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:02.863300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-36a49e45-b6d5-41c6-ba7b-5878ef5e3fed tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Getting quotas for project 2ae12b8f8a7f40758ca0edaeea7022ab. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:49:02.867308 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-36a49e45-b6d5-41c6-ba7b-5878ef5e3fed tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Getting quotas for user 396a79cbb4e9494791422713c596bc0c and project 2ae12b8f8a7f40758ca0edaeea7022ab. Resources: {'key_pairs'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:49:02.892023 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-36a49e45-b6d5-41c6-ba7b-5878ef5e3fed tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050160 Aug 05 20:49:02.892623 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 357/675] 10.222.0.100 () {60 vars in 1164 bytes} [Fri Aug 5 20:49:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:03.838497 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7e077d4f-5686-4673-8173-4594cfbf26a9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:03.839094 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-7e077d4f-5686-4673-8173-4594cfbf26a9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:03.852343 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e077d4f-5686-4673-8173-4594cfbf26a9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:03.852864 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e077d4f-5686-4673-8173-4594cfbf26a9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:03.853260 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e077d4f-5686-4673-8173-4594cfbf26a9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:03.853975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e077d4f-5686-4673-8173-4594cfbf26a9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:03.854417 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e077d4f-5686-4673-8173-4594cfbf26a9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:03.854867 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e077d4f-5686-4673-8173-4594cfbf26a9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:04.077007 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7e077d4f-5686-4673-8173-4594cfbf26a9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:04.086226 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-7e077d4f-5686-4673-8173-4594cfbf26a9 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.251222 Aug 05 20:49:04.087395 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 319/676] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:03 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:04.345054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1507375866", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf8c0cd9-83e1-49c1-9653-160ea22387f7"}], "security_groups": [{"name": "tempest-securitygroup--399765241"}], "key_name": "tempest-keypair-1497565594", "user_data": "}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:04.452655 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] validate_networks() for [('cf8c0cd9-83e1-49c1-9653-160ea22387f7', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:49:04.842795 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:49:04.843253 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:49:04.843764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:49:04.844172 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:49:04.844589 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:49:04.853839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:04.854333 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:04.854782 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:04.855553 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:04.855997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:04.856430 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:04.873150 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Getting quotas for project 2ae12b8f8a7f40758ca0edaeea7022ab. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:49:04.877204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Getting quotas for user 396a79cbb4e9494791422713c596bc0c and project 2ae12b8f8a7f40758ca0edaeea7022ab. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:49:04.889061 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:49:04.891325 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:49:04.941843 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-125340e9-779a-4016-9a01-9af1e06b3690 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.601087 Aug 05 20:49:04.942516 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 358/677] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:49:04 2022] POST /compute/v2.1/servers => generated 403 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:49:04.954177 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-be4bf127-7756-4daf-8efd-f93cffdbbc87 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:04.954849 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-be4bf127-7756-4daf-8efd-f93cffdbbc87 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:05.011335 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-be4bf127-7756-4daf-8efd-f93cffdbbc87 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:05.017958 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-be4bf127-7756-4daf-8efd-f93cffdbbc87 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1242 microversion: 2.1 time: 0.067905 Aug 05 20:49:05.018521 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 320/678] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:04 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:05.107658 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d621b54b-ce41-47d9-b34d-05a417e68cdd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:05.108307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d621b54b-ce41-47d9-b34d-05a417e68cdd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:05.115522 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d621b54b-ce41-47d9-b34d-05a417e68cdd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:05.116744 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d621b54b-ce41-47d9-b34d-05a417e68cdd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:05.117349 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d621b54b-ce41-47d9-b34d-05a417e68cdd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:05.117979 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d621b54b-ce41-47d9-b34d-05a417e68cdd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:05.118440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d621b54b-ce41-47d9-b34d-05a417e68cdd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:05.118931 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d621b54b-ce41-47d9-b34d-05a417e68cdd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:05.256390 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d621b54b-ce41-47d9-b34d-05a417e68cdd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:05.264973 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d621b54b-ce41-47d9-b34d-05a417e68cdd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.161242 Aug 05 20:49:05.265533 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 359/679] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:05 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:06.040921 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e4049adc-e972-49b3-acc9-83d483d49d25 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:06.042658 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e4049adc-e972-49b3-acc9-83d483d49d25 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:06.050762 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e4049adc-e972-49b3-acc9-83d483d49d25 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:06.051640 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e4049adc-e972-49b3-acc9-83d483d49d25 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:06.052307 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e4049adc-e972-49b3-acc9-83d483d49d25 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:06.053432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e4049adc-e972-49b3-acc9-83d483d49d25 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:06.054083 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e4049adc-e972-49b3-acc9-83d483d49d25 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:06.054732 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e4049adc-e972-49b3-acc9-83d483d49d25 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:06.162854 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-e4049adc-e972-49b3-acc9-83d483d49d25 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:06.171331 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e4049adc-e972-49b3-acc9-83d483d49d25 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1312 microversion: 2.1 time: 0.136311 Aug 05 20:49:06.172222 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 321/680] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:06 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1312 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:06.287934 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7f88da91-ac09-46b0-94ee-10ee3103107a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:06.288697 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7f88da91-ac09-46b0-94ee-10ee3103107a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:06.296699 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f88da91-ac09-46b0-94ee-10ee3103107a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:06.297723 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f88da91-ac09-46b0-94ee-10ee3103107a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:06.298427 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f88da91-ac09-46b0-94ee-10ee3103107a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:06.299326 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f88da91-ac09-46b0-94ee-10ee3103107a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:06.299902 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f88da91-ac09-46b0-94ee-10ee3103107a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:06.300398 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7f88da91-ac09-46b0-94ee-10ee3103107a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:06.496897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7f88da91-ac09-46b0-94ee-10ee3103107a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:06.505320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7f88da91-ac09-46b0-94ee-10ee3103107a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.222227 Aug 05 20:49:06.506389 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 360/681] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:06 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:07.192638 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-220e1536-af30-4b19-8c0c-32239afce02e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:07.193353 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-220e1536-af30-4b19-8c0c-32239afce02e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:07.200413 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-220e1536-af30-4b19-8c0c-32239afce02e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:07.200971 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-220e1536-af30-4b19-8c0c-32239afce02e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:07.201467 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-220e1536-af30-4b19-8c0c-32239afce02e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:07.202220 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-220e1536-af30-4b19-8c0c-32239afce02e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:07.202759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-220e1536-af30-4b19-8c0c-32239afce02e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:07.203239 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-220e1536-af30-4b19-8c0c-32239afce02e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:07.342585 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-220e1536-af30-4b19-8c0c-32239afce02e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:07.350429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-220e1536-af30-4b19-8c0c-32239afce02e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1367 microversion: 2.1 time: 0.161680 Aug 05 20:49:07.351112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 322/682] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:07 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:07.530105 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-47241f68-566d-4cb7-91b9-bbed7a7016c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:07.530720 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-47241f68-566d-4cb7-91b9-bbed7a7016c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:07.537989 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47241f68-566d-4cb7-91b9-bbed7a7016c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:07.539263 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47241f68-566d-4cb7-91b9-bbed7a7016c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:07.539891 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47241f68-566d-4cb7-91b9-bbed7a7016c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:07.540814 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47241f68-566d-4cb7-91b9-bbed7a7016c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:07.541769 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47241f68-566d-4cb7-91b9-bbed7a7016c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:07.542476 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-47241f68-566d-4cb7-91b9-bbed7a7016c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:07.544931 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-32fd11c7-8c56-4b7f-a462-b16565ac3765 req-ae77df08-ea92-4cf7-850d-93fe7bb0a999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b095014-137c-4100-a4a2-69023e2cd17d", "tag": "d2a706ca-b155-421d-9feb-94b85b3c5644"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:07.554871 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-32fd11c7-8c56-4b7f-a462-b16565ac3765 req-ae77df08-ea92-4cf7-850d-93fe7bb0a999 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:07.555744 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-32fd11c7-8c56-4b7f-a462-b16565ac3765 req-ae77df08-ea92-4cf7-850d-93fe7bb0a999 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:07.556199 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-32fd11c7-8c56-4b7f-a462-b16565ac3765 req-ae77df08-ea92-4cf7-850d-93fe7bb0a999 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:07.567672 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-32fd11c7-8c56-4b7f-a462-b16565ac3765 req-ae77df08-ea92-4cf7-850d-93fe7bb0a999 service nova] Creating event network-changed:d2a706ca-b155-421d-9feb-94b85b3c5644 for instance 0b095014-137c-4100-a4a2-69023e2cd17d on hv-cinder-85220 Aug 05 20:49:07.574615 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-32fd11c7-8c56-4b7f-a462-b16565ac3765 req-ae77df08-ea92-4cf7-850d-93fe7bb0a999 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032663 Aug 05 20:49:07.575566 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 323/683] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:07.700082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-47241f68-566d-4cb7-91b9-bbed7a7016c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:07.711114 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-47241f68-566d-4cb7-91b9-bbed7a7016c4 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.186891 Aug 05 20:49:07.711889 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 361/684] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:07 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:08.211444 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4d4eb351-a2d8-40ae-9aa9-bbcc40fe1b18 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:08.212064 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4d4eb351-a2d8-40ae-9aa9-bbcc40fe1b18 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:08.218916 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4d4eb351-a2d8-40ae-9aa9-bbcc40fe1b18 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:08.219398 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4d4eb351-a2d8-40ae-9aa9-bbcc40fe1b18 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:08.219866 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4d4eb351-a2d8-40ae-9aa9-bbcc40fe1b18 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:08.220549 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4d4eb351-a2d8-40ae-9aa9-bbcc40fe1b18 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:08.221017 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4d4eb351-a2d8-40ae-9aa9-bbcc40fe1b18 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:08.221417 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4d4eb351-a2d8-40ae-9aa9-bbcc40fe1b18 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:08.245351 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4d4eb351-a2d8-40ae-9aa9-bbcc40fe1b18 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/ips" status: 200 len: 149 microversion: 2.1 time: 0.103659 Aug 05 20:49:08.245892 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 324/685] 10.222.0.100 () {58 vars in 1253 bytes} [Fri Aug 5 20:49:08 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/ips => generated 149 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:08.429484 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0a7c11e4-9a91-4ffa-99f5-1eca140aeeb8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:08.430295 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0a7c11e4-9a91-4ffa-99f5-1eca140aeeb8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:08.437508 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a7c11e4-9a91-4ffa-99f5-1eca140aeeb8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:08.438315 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a7c11e4-9a91-4ffa-99f5-1eca140aeeb8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:08.438876 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a7c11e4-9a91-4ffa-99f5-1eca140aeeb8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:08.439671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a7c11e4-9a91-4ffa-99f5-1eca140aeeb8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:08.440223 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a7c11e4-9a91-4ffa-99f5-1eca140aeeb8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:08.440750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0a7c11e4-9a91-4ffa-99f5-1eca140aeeb8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:08.581335 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0a7c11e4-9a91-4ffa-99f5-1eca140aeeb8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:08.589661 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0a7c11e4-9a91-4ffa-99f5-1eca140aeeb8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1367 microversion: 2.1 time: 0.221189 Aug 05 20:49:08.590320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 362/686] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:08 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:08.736432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8aa8bc9f-2cec-415e-9cf8-277146c5eb1d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:08.737467 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8aa8bc9f-2cec-415e-9cf8-277146c5eb1d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:08.745885 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8aa8bc9f-2cec-415e-9cf8-277146c5eb1d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:08.746382 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8aa8bc9f-2cec-415e-9cf8-277146c5eb1d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:08.746821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8aa8bc9f-2cec-415e-9cf8-277146c5eb1d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:08.747581 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8aa8bc9f-2cec-415e-9cf8-277146c5eb1d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:08.748049 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8aa8bc9f-2cec-415e-9cf8-277146c5eb1d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:08.748462 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8aa8bc9f-2cec-415e-9cf8-277146c5eb1d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:08.906908 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8aa8bc9f-2cec-415e-9cf8-277146c5eb1d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:08.915226 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8aa8bc9f-2cec-415e-9cf8-277146c5eb1d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.185394 Aug 05 20:49:08.915794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 325/687] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:08 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:09.597728 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9e7e504b-ca7f-45a7-8c2b-9a8886a1dec5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0a3cfdf-7aeb-4cb5-94e5-e2c3a385c1ee"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:09.600262 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9e7e504b-ca7f-45a7-8c2b-9a8886a1dec5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:09.606949 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e7e504b-ca7f-45a7-8c2b-9a8886a1dec5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:09.607443 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e7e504b-ca7f-45a7-8c2b-9a8886a1dec5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:09.607876 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e7e504b-ca7f-45a7-8c2b-9a8886a1dec5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:09.608585 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e7e504b-ca7f-45a7-8c2b-9a8886a1dec5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:09.609043 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e7e504b-ca7f-45a7-8c2b-9a8886a1dec5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:09.609469 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e7e504b-ca7f-45a7-8c2b-9a8886a1dec5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:09.610936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9e90c414-5e9b-4b91-8432-f3a2dd620f7f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:09.611739 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9e90c414-5e9b-4b91-8432-f3a2dd620f7f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:09.619831 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9e90c414-5e9b-4b91-8432-f3a2dd620f7f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:09.620464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9e90c414-5e9b-4b91-8432-f3a2dd620f7f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:09.621002 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9e90c414-5e9b-4b91-8432-f3a2dd620f7f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:09.621819 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9e90c414-5e9b-4b91-8432-f3a2dd620f7f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:09.622395 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9e90c414-5e9b-4b91-8432-f3a2dd620f7f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:09.622938 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9e90c414-5e9b-4b91-8432-f3a2dd620f7f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:09.756855 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-9e90c414-5e9b-4b91-8432-f3a2dd620f7f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:09.765178 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9e90c414-5e9b-4b91-8432-f3a2dd620f7f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1367 microversion: 2.1 time: 0.158917 Aug 05 20:49:09.765759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 326/688] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:09 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:09.878203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9e7e504b-ca7f-45a7-8c2b-9a8886a1dec5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "POST /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284563 Aug 05 20:49:09.878817 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 363/689] 10.222.0.100 () {60 vars in 1328 bytes} [Fri Aug 5 20:49:09 2022] POST /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:09.941007 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-bb966fab-c52f-49b7-abcd-8bdf90c6e8cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:09.941007 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-bb966fab-c52f-49b7-abcd-8bdf90c6e8cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:09.945466 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bb966fab-c52f-49b7-abcd-8bdf90c6e8cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:09.946052 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bb966fab-c52f-49b7-abcd-8bdf90c6e8cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:09.946584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bb966fab-c52f-49b7-abcd-8bdf90c6e8cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:09.947496 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bb966fab-c52f-49b7-abcd-8bdf90c6e8cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:09.948047 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bb966fab-c52f-49b7-abcd-8bdf90c6e8cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:09.948387 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bb966fab-c52f-49b7-abcd-8bdf90c6e8cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:10.083491 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-bb966fab-c52f-49b7-abcd-8bdf90c6e8cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:10.091883 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-bb966fab-c52f-49b7-abcd-8bdf90c6e8cd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.157980 Aug 05 20:49:10.092382 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 327/690] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:09 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:10.789694 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-36e55c32-85d6-4f43-b5c6-7ed886125d9b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:10.790659 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-36e55c32-85d6-4f43-b5c6-7ed886125d9b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:10.797804 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36e55c32-85d6-4f43-b5c6-7ed886125d9b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:10.798294 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36e55c32-85d6-4f43-b5c6-7ed886125d9b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:10.798731 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36e55c32-85d6-4f43-b5c6-7ed886125d9b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:10.799463 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36e55c32-85d6-4f43-b5c6-7ed886125d9b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:10.799926 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36e55c32-85d6-4f43-b5c6-7ed886125d9b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:10.800418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-36e55c32-85d6-4f43-b5c6-7ed886125d9b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:10.943625 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-36e55c32-85d6-4f43-b5c6-7ed886125d9b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:10.953045 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-36e55c32-85d6-4f43-b5c6-7ed886125d9b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1367 microversion: 2.1 time: 0.169080 Aug 05 20:49:10.953626 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 364/691] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:10 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:11.115843 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-afacc361-7d93-4190-b163-d295a7efc275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:11.116490 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-afacc361-7d93-4190-b163-d295a7efc275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:11.123965 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-afacc361-7d93-4190-b163-d295a7efc275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:11.124434 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-afacc361-7d93-4190-b163-d295a7efc275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:11.124889 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-afacc361-7d93-4190-b163-d295a7efc275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:11.125564 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-afacc361-7d93-4190-b163-d295a7efc275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:11.126019 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-afacc361-7d93-4190-b163-d295a7efc275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:11.126446 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-afacc361-7d93-4190-b163-d295a7efc275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:11.282625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-afacc361-7d93-4190-b163-d295a7efc275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:11.291653 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-afacc361-7d93-4190-b163-d295a7efc275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.180702 Aug 05 20:49:11.292233 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 328/692] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:11 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:11.974828 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9297536e-9ad3-484c-9085-5c4aac399a8f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:11.975344 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9297536e-9ad3-484c-9085-5c4aac399a8f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:11.982459 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9297536e-9ad3-484c-9085-5c4aac399a8f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:11.982950 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9297536e-9ad3-484c-9085-5c4aac399a8f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:11.983387 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9297536e-9ad3-484c-9085-5c4aac399a8f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:11.984098 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9297536e-9ad3-484c-9085-5c4aac399a8f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:11.984553 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9297536e-9ad3-484c-9085-5c4aac399a8f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:11.985005 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9297536e-9ad3-484c-9085-5c4aac399a8f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:12.117128 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9297536e-9ad3-484c-9085-5c4aac399a8f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:12.124757 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9297536e-9ad3-484c-9085-5c4aac399a8f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1367 microversion: 2.1 time: 0.154019 Aug 05 20:49:12.125356 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 365/693] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:11 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:12.315404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-2d6cb581-7b83-46f9-baca-cb3b7db38e2c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:12.316273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-2d6cb581-7b83-46f9-baca-cb3b7db38e2c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:12.326249 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2d6cb581-7b83-46f9-baca-cb3b7db38e2c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:12.326936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2d6cb581-7b83-46f9-baca-cb3b7db38e2c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:12.327602 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2d6cb581-7b83-46f9-baca-cb3b7db38e2c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:12.328571 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2d6cb581-7b83-46f9-baca-cb3b7db38e2c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:12.329207 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2d6cb581-7b83-46f9-baca-cb3b7db38e2c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:12.329802 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2d6cb581-7b83-46f9-baca-cb3b7db38e2c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:12.347065 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:12.466893 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2d6cb581-7b83-46f9-baca-cb3b7db38e2c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:12.479019 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-2d6cb581-7b83-46f9-baca-cb3b7db38e2c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.168971 Aug 05 20:49:12.479795 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 329/694] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:12 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:13.146588 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fbe54467-674b-4bbe-a9c8-526e58e1c543 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:13.147149 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fbe54467-674b-4bbe-a9c8-526e58e1c543 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:13.150266 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:13.156647 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fbe54467-674b-4bbe-a9c8-526e58e1c543 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:13.157133 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fbe54467-674b-4bbe-a9c8-526e58e1c543 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:13.157547 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fbe54467-674b-4bbe-a9c8-526e58e1c543 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:13.158230 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fbe54467-674b-4bbe-a9c8-526e58e1c543 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:13.158673 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fbe54467-674b-4bbe-a9c8-526e58e1c543 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:13.159088 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fbe54467-674b-4bbe-a9c8-526e58e1c543 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:13.309141 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fbe54467-674b-4bbe-a9c8-526e58e1c543 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:13.316804 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fbe54467-674b-4bbe-a9c8-526e58e1c543 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1367 microversion: 2.1 time: 0.174225 Aug 05 20:49:13.317375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 366/695] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:13 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:13.507705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f244bba9-b5c4-42c6-8b55-c4acfde3b8fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:13.508859 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f244bba9-b5c4-42c6-8b55-c4acfde3b8fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:13.515726 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f244bba9-b5c4-42c6-8b55-c4acfde3b8fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:13.516222 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f244bba9-b5c4-42c6-8b55-c4acfde3b8fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:13.516671 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f244bba9-b5c4-42c6-8b55-c4acfde3b8fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:13.517358 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f244bba9-b5c4-42c6-8b55-c4acfde3b8fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:13.517970 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f244bba9-b5c4-42c6-8b55-c4acfde3b8fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:13.518237 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f244bba9-b5c4-42c6-8b55-c4acfde3b8fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:13.666296 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f244bba9-b5c4-42c6-8b55-c4acfde3b8fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:13.674745 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f244bba9-b5c4-42c6-8b55-c4acfde3b8fa tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.172464 Aug 05 20:49:13.675325 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 330/696] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:13 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:14.207506 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-a24480ca-666c-4cd2-b4bf-a8d6c8bd92f4 req-e2ccf57d-bcba-47bc-a1f7-61f88850036f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b095014-137c-4100-a4a2-69023e2cd17d", "name": "network-vif-plugged", "status": "completed", "tag": "d2a706ca-b155-421d-9feb-94b85b3c5644"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:14.223694 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a24480ca-666c-4cd2-b4bf-a8d6c8bd92f4 req-e2ccf57d-bcba-47bc-a1f7-61f88850036f service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:14.224488 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a24480ca-666c-4cd2-b4bf-a8d6c8bd92f4 req-e2ccf57d-bcba-47bc-a1f7-61f88850036f service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:14.225263 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a24480ca-666c-4cd2-b4bf-a8d6c8bd92f4 req-e2ccf57d-bcba-47bc-a1f7-61f88850036f service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:14.237792 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-a24480ca-666c-4cd2-b4bf-a8d6c8bd92f4 req-e2ccf57d-bcba-47bc-a1f7-61f88850036f service nova] Creating event network-vif-plugged:d2a706ca-b155-421d-9feb-94b85b3c5644 for instance 0b095014-137c-4100-a4a2-69023e2cd17d on hv-cinder-85220 Aug 05 20:49:14.243425 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-a24480ca-666c-4cd2-b4bf-a8d6c8bd92f4 req-e2ccf57d-bcba-47bc-a1f7-61f88850036f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039427 Aug 05 20:49:14.244258 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 367/697] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:14.338277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c2e507eb-998f-4ed7-9538-33e71a3c6396 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:14.338916 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c2e507eb-998f-4ed7-9538-33e71a3c6396 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:14.345767 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2e507eb-998f-4ed7-9538-33e71a3c6396 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:14.346270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2e507eb-998f-4ed7-9538-33e71a3c6396 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:14.346697 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2e507eb-998f-4ed7-9538-33e71a3c6396 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:14.347799 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2e507eb-998f-4ed7-9538-33e71a3c6396 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:14.348404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2e507eb-998f-4ed7-9538-33e71a3c6396 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:14.348905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2e507eb-998f-4ed7-9538-33e71a3c6396 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:14.498869 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c2e507eb-998f-4ed7-9538-33e71a3c6396 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:14.506418 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c2e507eb-998f-4ed7-9538-33e71a3c6396 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1367 microversion: 2.1 time: 0.172252 Aug 05 20:49:14.506994 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 331/698] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:14 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:14.700371 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8e9a0e4c-f1a7-4b32-9ee7-5652700dab1a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:14.701362 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8e9a0e4c-f1a7-4b32-9ee7-5652700dab1a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:14.710926 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8e9a0e4c-f1a7-4b32-9ee7-5652700dab1a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:14.711769 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8e9a0e4c-f1a7-4b32-9ee7-5652700dab1a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:14.712218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8e9a0e4c-f1a7-4b32-9ee7-5652700dab1a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:14.713018 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8e9a0e4c-f1a7-4b32-9ee7-5652700dab1a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:14.713473 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8e9a0e4c-f1a7-4b32-9ee7-5652700dab1a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:14.713897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8e9a0e4c-f1a7-4b32-9ee7-5652700dab1a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:14.851258 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8e9a0e4c-f1a7-4b32-9ee7-5652700dab1a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:14.859829 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8e9a0e4c-f1a7-4b32-9ee7-5652700dab1a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.166201 Aug 05 20:49:14.860390 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 368/699] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:14 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:15.530040 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-82424827-a264-4763-8a28-5843f4ef174e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:15.530720 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-82424827-a264-4763-8a28-5843f4ef174e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:15.533545 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:15.540377 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-82424827-a264-4763-8a28-5843f4ef174e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:15.541143 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-82424827-a264-4763-8a28-5843f4ef174e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:15.541662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-82424827-a264-4763-8a28-5843f4ef174e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:15.542482 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-82424827-a264-4763-8a28-5843f4ef174e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:15.543035 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-82424827-a264-4763-8a28-5843f4ef174e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:15.543591 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-82424827-a264-4763-8a28-5843f4ef174e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:15.682607 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-82424827-a264-4763-8a28-5843f4ef174e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:15.694057 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-82424827-a264-4763-8a28-5843f4ef174e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1367 microversion: 2.1 time: 0.169209 Aug 05 20:49:15.694818 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 332/700] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:15 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:15.885161 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c8c14cbf-1547-4e5f-b8c2-0ea0410b3a41 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:15.885703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c8c14cbf-1547-4e5f-b8c2-0ea0410b3a41 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:15.887681 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:15.888351 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=10 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:15.895034 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c8c14cbf-1547-4e5f-b8c2-0ea0410b3a41 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:15.895559 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c8c14cbf-1547-4e5f-b8c2-0ea0410b3a41 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:15.895996 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c8c14cbf-1547-4e5f-b8c2-0ea0410b3a41 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:15.896697 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c8c14cbf-1547-4e5f-b8c2-0ea0410b3a41 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:15.897151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c8c14cbf-1547-4e5f-b8c2-0ea0410b3a41 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:15.897579 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c8c14cbf-1547-4e5f-b8c2-0ea0410b3a41 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:15.900242 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:16.037768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c8c14cbf-1547-4e5f-b8c2-0ea0410b3a41 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:16.046160 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c8c14cbf-1547-4e5f-b8c2-0ea0410b3a41 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.167121 Aug 05 20:49:16.046703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 369/701] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:15 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:16.715841 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ecdb1653-71f3-47c0-bed7-ade50fec083b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:16.716462 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ecdb1653-71f3-47c0-bed7-ade50fec083b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:16.723120 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ecdb1653-71f3-47c0-bed7-ade50fec083b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:16.723625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ecdb1653-71f3-47c0-bed7-ade50fec083b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:16.724060 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ecdb1653-71f3-47c0-bed7-ade50fec083b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:16.724763 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ecdb1653-71f3-47c0-bed7-ade50fec083b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:16.725218 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ecdb1653-71f3-47c0-bed7-ade50fec083b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:16.725637 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ecdb1653-71f3-47c0-bed7-ade50fec083b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:16.860253 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ecdb1653-71f3-47c0-bed7-ade50fec083b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:16.870105 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ecdb1653-71f3-47c0-bed7-ade50fec083b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1553 microversion: 2.1 time: 0.158077 Aug 05 20:49:16.870650 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 333/702] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:16 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:16.890049 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f28411c2-40cc-4b89-9e51-cfb3a8e96a4d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:16.890544 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f28411c2-40cc-4b89-9e51-cfb3a8e96a4d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:16.897689 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f28411c2-40cc-4b89-9e51-cfb3a8e96a4d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:16.898173 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f28411c2-40cc-4b89-9e51-cfb3a8e96a4d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:16.898606 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f28411c2-40cc-4b89-9e51-cfb3a8e96a4d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:16.899457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f28411c2-40cc-4b89-9e51-cfb3a8e96a4d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:16.899914 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f28411c2-40cc-4b89-9e51-cfb3a8e96a4d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:16.900335 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f28411c2-40cc-4b89-9e51-cfb3a8e96a4d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:16.993322 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f28411c2-40cc-4b89-9e51-cfb3a8e96a4d tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107028 Aug 05 20:49:16.993913 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 370/703] 10.222.0.100 () {58 vars in 1280 bytes} [Fri Aug 5 20:49:16 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:17.071430 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-620b5361-4c76-45dc-adac-b0d5d2cda6f7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:17.072966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-620b5361-4c76-45dc-adac-b0d5d2cda6f7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:17.080686 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-620b5361-4c76-45dc-adac-b0d5d2cda6f7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:17.082800 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-620b5361-4c76-45dc-adac-b0d5d2cda6f7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:17.083289 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-620b5361-4c76-45dc-adac-b0d5d2cda6f7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:17.084146 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-620b5361-4c76-45dc-adac-b0d5d2cda6f7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:17.084680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-620b5361-4c76-45dc-adac-b0d5d2cda6f7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:17.085164 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-620b5361-4c76-45dc-adac-b0d5d2cda6f7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:17.225088 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-620b5361-4c76-45dc-adac-b0d5d2cda6f7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:17.233730 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-620b5361-4c76-45dc-adac-b0d5d2cda6f7 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.169264 Aug 05 20:49:17.234503 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 334/704] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:17 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:17.440263 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-709ff75f-bf38-488a-a3b7-5a1041066457 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0a3cfdf-7aeb-4cb5-94e5-e2c3a385c1ee"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:17.442731 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-709ff75f-bf38-488a-a3b7-5a1041066457 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:17.449168 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-709ff75f-bf38-488a-a3b7-5a1041066457 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:17.449651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-709ff75f-bf38-488a-a3b7-5a1041066457 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:17.450113 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-709ff75f-bf38-488a-a3b7-5a1041066457 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:17.450831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-709ff75f-bf38-488a-a3b7-5a1041066457 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:17.451277 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-709ff75f-bf38-488a-a3b7-5a1041066457 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:17.451731 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-709ff75f-bf38-488a-a3b7-5a1041066457 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:17.535889 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-709ff75f-bf38-488a-a3b7-5a1041066457 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] HTTP exception thrown: Invalid volume: volume c0a3cfdf-7aeb-4cb5-94e5-e2c3a385c1ee is already attached to instances: 26a70e3c-12e4-4459-b22d-b9152f1987c1 Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-709ff75f-bf38-488a-a3b7-5a1041066457 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Request method failure captured: Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: POST /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-volume_attachments HTTP/1.1 Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 74 Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEVT2RIo0sOYhrqEh_HYIhCXXgNEIU5O2TrKSb8O78pPQouV0XDBbsdQswVZsYX73wXTNNa6pCEJklCAufLFYW63yx7CPEVZ0Ry2Y0Ikjromqqlux7d4-wF_GlTFyol_iESoMY4-E-LXutqB0V3ogXtBOvhKaWzWfUtI3jvN-kS_PY Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:49:17.537646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:49:17.539037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8b67138a484f481099c562d7e3ca8401", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:49:17.539037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:49:17.539037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:49:17.539037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:49:17.539037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:49:17.539037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:49:17.539037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:49:17.539037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 8e1baad75342476aa0c64bda0414e334 Aug 05 20:49:17.539037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:49:17.539037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Aug 05 20:49:17.539037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {"volumeAttachment": {"volumeId": "c0a3cfdf-7aeb-4cb5-94e5-e2c3a385c1ee"}} Aug 05 20:49:17.539037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Invalid volume: volume c0a3cfdf-7aeb-4cb5-94e5-e2c3a385c1ee is already attached to instances: 26a70e3c-12e4-4459-b22d-b9152f1987c1 Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'server_id': '26a70e3c-12e4-4459-b22d-b9152f1987c1', 'body': {'volumeAttachment': {'volumeId': 'c0a3cfdf-7aeb-4cb5-94e5-e2c3a385c1ee'}}} Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c0a3cfdf-7aeb-4cb5-94e5-e2c3a385c1ee is already attached to instances: 26a70e3c-12e4-4459-b22d-b9152f1987c1 Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:17.540089 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c0a3cfdf-7aeb-4cb5-94e5-e2c3a385c1ee is already attached to instances: 26a70e3c-12e4-4459-b22d-b9152f1987c1 Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:17.541370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:49:17.542578 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:49:17.542578 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:49:17.542578 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:49:17.542578 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c0a3cfdf-7aeb-4cb5-94e5-e2c3a385c1ee is already attached to instances: 26a70e3c-12e4-4459-b22d-b9152f1987c1 Aug 05 20:49:17.542578 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:17.542578 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-709ff75f-bf38-488a-a3b7-5a1041066457 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Returning 400 to user: Invalid volume: volume c0a3cfdf-7aeb-4cb5-94e5-e2c3a385c1ee is already attached to instances: 26a70e3c-12e4-4459-b22d-b9152f1987c1 {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:49:17.542578 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-709ff75f-bf38-488a-a3b7-5a1041066457 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "POST /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103184 Aug 05 20:49:17.542578 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 371/705] 10.222.0.100 () {60 vars in 1328 bytes} [Fri Aug 5 20:49:17 2022] POST /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:49:17.604357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ce500435-00e9-413d-8d94-85d065ea41b0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:17.604861 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ce500435-00e9-413d-8d94-85d065ea41b0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:17.611028 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce500435-00e9-413d-8d94-85d065ea41b0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:17.611552 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce500435-00e9-413d-8d94-85d065ea41b0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:17.611968 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce500435-00e9-413d-8d94-85d065ea41b0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:17.612667 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce500435-00e9-413d-8d94-85d065ea41b0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:17.613130 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce500435-00e9-413d-8d94-85d065ea41b0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:17.613559 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ce500435-00e9-413d-8d94-85d065ea41b0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:17.700053 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-ce500435-00e9-413d-8d94-85d065ea41b0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lazy-loading 'services' on Instance uuid 26a70e3c-12e4-4459-b22d-b9152f1987c1 {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:49:17.776915 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ce500435-00e9-413d-8d94-85d065ea41b0 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-volume_attachments/c0a3cfdf-7aeb-4cb5-94e5-e2c3a385c1ee" status: 202 len: 0 microversion: 2.1 time: 0.176533 Aug 05 20:49:17.781214 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 335/706] 10.222.0.100 () {58 vars in 1421 bytes} [Fri Aug 5 20:49:17 2022] DELETE /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-volume_attachments/c0a3cfdf-7aeb-4cb5-94e5-e2c3a385c1ee => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:49:17.786536 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8d5cdb44-8785-4d45-ae94-48fac24c167e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:17.788812 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8d5cdb44-8785-4d45-ae94-48fac24c167e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:17.794981 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8d5cdb44-8785-4d45-ae94-48fac24c167e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:17.795496 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8d5cdb44-8785-4d45-ae94-48fac24c167e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:17.795933 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8d5cdb44-8785-4d45-ae94-48fac24c167e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:17.796625 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8d5cdb44-8785-4d45-ae94-48fac24c167e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:17.797086 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8d5cdb44-8785-4d45-ae94-48fac24c167e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:17.797527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8d5cdb44-8785-4d45-ae94-48fac24c167e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:17.829028 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8d5cdb44-8785-4d45-ae94-48fac24c167e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046124 Aug 05 20:49:17.833412 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 372/707] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:49:17 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:17.914016 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f05ce374-fbc3-4b92-8588-6f11ec11c55f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-662722441"}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:17.914666 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f05ce374-fbc3-4b92-8588-6f11ec11c55f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:17.922520 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f05ce374-fbc3-4b92-8588-6f11ec11c55f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:17.922993 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f05ce374-fbc3-4b92-8588-6f11ec11c55f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:17.923801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f05ce374-fbc3-4b92-8588-6f11ec11c55f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:17.924177 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f05ce374-fbc3-4b92-8588-6f11ec11c55f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:17.924595 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f05ce374-fbc3-4b92-8588-6f11ec11c55f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:17.925034 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f05ce374-fbc3-4b92-8588-6f11ec11c55f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:18.065902 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.network.security_group_api [None req-f05ce374-fbc3-4b92-8588-6f11ec11c55f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Removing security group 8bf9f684-a512-4fb8-add3-255d631545a7 from port ff5e6ab7-ec2b-46dd-b050-f4b9bceff071 Aug 05 20:49:18.192094 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-1d9e9e86-1aac-453e-ba46-a04c42e8f817 req-cd28ee72-533c-4f64-b2ef-1f42efe6d9dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b095014-137c-4100-a4a2-69023e2cd17d", "tag": "d2a706ca-b155-421d-9feb-94b85b3c5644"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:18.203968 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-1d9e9e86-1aac-453e-ba46-a04c42e8f817 req-cd28ee72-533c-4f64-b2ef-1f42efe6d9dd service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:18.204725 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-1d9e9e86-1aac-453e-ba46-a04c42e8f817 req-cd28ee72-533c-4f64-b2ef-1f42efe6d9dd service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:18.205250 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-1d9e9e86-1aac-453e-ba46-a04c42e8f817 req-cd28ee72-533c-4f64-b2ef-1f42efe6d9dd service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:18.220411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-1d9e9e86-1aac-453e-ba46-a04c42e8f817 req-cd28ee72-533c-4f64-b2ef-1f42efe6d9dd service nova] Creating event network-changed:d2a706ca-b155-421d-9feb-94b85b3c5644 for instance 0b095014-137c-4100-a4a2-69023e2cd17d on hv-cinder-85220 Aug 05 20:49:18.225706 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-1d9e9e86-1aac-453e-ba46-a04c42e8f817 req-cd28ee72-533c-4f64-b2ef-1f42efe6d9dd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037291 Aug 05 20:49:18.226611 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 373/708] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:18.256361 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5d058f72-b6e8-4b5c-bc26-5938a522f065 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:18.257071 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5d058f72-b6e8-4b5c-bc26-5938a522f065 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:18.264019 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d058f72-b6e8-4b5c-bc26-5938a522f065 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:18.264533 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d058f72-b6e8-4b5c-bc26-5938a522f065 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:18.264983 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d058f72-b6e8-4b5c-bc26-5938a522f065 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:18.265681 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d058f72-b6e8-4b5c-bc26-5938a522f065 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:18.266171 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d058f72-b6e8-4b5c-bc26-5938a522f065 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:18.266599 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d058f72-b6e8-4b5c-bc26-5938a522f065 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:18.545004 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f05ce374-fbc3-4b92-8588-6f11ec11c55f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "POST /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.635529 Aug 05 20:49:18.546053 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 336/709] 10.222.0.100 () {60 vars in 1283 bytes} [Fri Aug 5 20:49:17 2022] POST /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/action => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:49:18.557558 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-457df442-6a22-411b-9263-572420cb7480 req-c9f06c6e-e8c6-42e8-8795-fd42d8e03525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a270d6db-218c-4081-81b9-b161dc70a7bb", "tag": "ff5e6ab7-ec2b-46dd-b050-f4b9bceff071"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:18.569055 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-457df442-6a22-411b-9263-572420cb7480 req-c9f06c6e-e8c6-42e8-8795-fd42d8e03525 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:18.570053 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-457df442-6a22-411b-9263-572420cb7480 req-c9f06c6e-e8c6-42e8-8795-fd42d8e03525 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:18.570795 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-457df442-6a22-411b-9263-572420cb7480 req-c9f06c6e-e8c6-42e8-8795-fd42d8e03525 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:18.584142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-457df442-6a22-411b-9263-572420cb7480 req-c9f06c6e-e8c6-42e8-8795-fd42d8e03525 service nova] Creating event network-changed:ff5e6ab7-ec2b-46dd-b050-f4b9bceff071 for instance a270d6db-218c-4081-81b9-b161dc70a7bb on hv-cinder-85220 Aug 05 20:49:18.590379 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-457df442-6a22-411b-9263-572420cb7480 req-c9f06c6e-e8c6-42e8-8795-fd42d8e03525 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036840 Aug 05 20:49:18.591475 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 337/710] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:18.628066 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5d058f72-b6e8-4b5c-bc26-5938a522f065 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:18.641711 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5d058f72-b6e8-4b5c-bc26-5938a522f065 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.389832 Aug 05 20:49:18.643015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 374/711] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:18 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:18.842831 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-36a996d8-b188-4bee-8013-15ff6c676f37 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:18.845928 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-36a996d8-b188-4bee-8013-15ff6c676f37 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:18.855332 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36a996d8-b188-4bee-8013-15ff6c676f37 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:18.855859 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36a996d8-b188-4bee-8013-15ff6c676f37 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:18.856296 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36a996d8-b188-4bee-8013-15ff6c676f37 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:18.857084 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36a996d8-b188-4bee-8013-15ff6c676f37 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:18.857543 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36a996d8-b188-4bee-8013-15ff6c676f37 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:18.857967 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36a996d8-b188-4bee-8013-15ff6c676f37 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:18.922872 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-36a996d8-b188-4bee-8013-15ff6c676f37 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084946 Aug 05 20:49:18.924026 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 338/712] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:49:18 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:19.665797 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6ba698c5-e550-45f4-b419-69383a143f01 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:19.666981 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6ba698c5-e550-45f4-b419-69383a143f01 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:19.674051 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6ba698c5-e550-45f4-b419-69383a143f01 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:19.674537 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6ba698c5-e550-45f4-b419-69383a143f01 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:19.675125 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6ba698c5-e550-45f4-b419-69383a143f01 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:19.676569 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6ba698c5-e550-45f4-b419-69383a143f01 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:19.676569 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6ba698c5-e550-45f4-b419-69383a143f01 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:19.676780 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6ba698c5-e550-45f4-b419-69383a143f01 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:19.898850 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6ba698c5-e550-45f4-b419-69383a143f01 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:19.908972 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6ba698c5-e550-45f4-b419-69383a143f01 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1738 microversion: 2.1 time: 0.247781 Aug 05 20:49:19.909605 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 375/713] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:19 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:19.936109 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1e575d64-dc00-4bd7-9e96-5f0ad22a8d25 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:19.939188 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-1e575d64-dc00-4bd7-9e96-5f0ad22a8d25 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:19.947217 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e575d64-dc00-4bd7-9e96-5f0ad22a8d25 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:19.948070 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e575d64-dc00-4bd7-9e96-5f0ad22a8d25 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:19.951018 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e575d64-dc00-4bd7-9e96-5f0ad22a8d25 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:19.952080 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e575d64-dc00-4bd7-9e96-5f0ad22a8d25 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:19.952606 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e575d64-dc00-4bd7-9e96-5f0ad22a8d25 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:19.953100 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e575d64-dc00-4bd7-9e96-5f0ad22a8d25 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:19.984260 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-1e575d64-dc00-4bd7-9e96-5f0ad22a8d25 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052136 Aug 05 20:49:19.984817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 339/714] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:49:19 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:49:20.058578 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cdef3739-7172-41fd-8edb-1de339e654c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:20.059085 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cdef3739-7172-41fd-8edb-1de339e654c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:20.065624 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cdef3739-7172-41fd-8edb-1de339e654c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:20.066176 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cdef3739-7172-41fd-8edb-1de339e654c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:20.066554 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cdef3739-7172-41fd-8edb-1de339e654c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:20.067258 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cdef3739-7172-41fd-8edb-1de339e654c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:20.067730 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cdef3739-7172-41fd-8edb-1de339e654c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:20.068344 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cdef3739-7172-41fd-8edb-1de339e654c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:20.094215 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cdef3739-7172-41fd-8edb-1de339e654c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:49:20.137320 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c5ac3ace-3cb1-4bbb-bf3e-fbbf70788a56 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:20.137996 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c5ac3ace-3cb1-4bbb-bf3e-fbbf70788a56 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:20.145886 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c5ac3ace-3cb1-4bbb-bf3e-fbbf70788a56 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:20.146603 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c5ac3ace-3cb1-4bbb-bf3e-fbbf70788a56 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:20.147099 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c5ac3ace-3cb1-4bbb-bf3e-fbbf70788a56 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:20.148034 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c5ac3ace-3cb1-4bbb-bf3e-fbbf70788a56 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:20.148684 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c5ac3ace-3cb1-4bbb-bf3e-fbbf70788a56 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:20.149428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c5ac3ace-3cb1-4bbb-bf3e-fbbf70788a56 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:20.188295 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cdef3739-7172-41fd-8edb-1de339e654c2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 204 len: 0 microversion: 2.1 time: 0.133637 Aug 05 20:49:20.188916 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 376/715] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:49:20 2022] DELETE /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:49:20.198815 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d88dd360-da86-4c01-8193-ff0103a703f8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:20.199553 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d88dd360-da86-4c01-8193-ff0103a703f8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:20.205696 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d88dd360-da86-4c01-8193-ff0103a703f8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:20.206207 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d88dd360-da86-4c01-8193-ff0103a703f8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:20.206650 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d88dd360-da86-4c01-8193-ff0103a703f8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:20.207386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d88dd360-da86-4c01-8193-ff0103a703f8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:20.207835 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d88dd360-da86-4c01-8193-ff0103a703f8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:20.208260 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d88dd360-da86-4c01-8193-ff0103a703f8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:20.241190 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-c5ac3ace-3cb1-4bbb-bf3e-fbbf70788a56 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lazy-loading 'services' on Instance uuid a270d6db-218c-4081-81b9-b161dc70a7bb {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:49:20.330987 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c5ac3ace-3cb1-4bbb-bf3e-fbbf70788a56 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments/1cd0caf0-9f6b-44ee-83cb-7afe693758fd" status: 202 len: 0 microversion: 2.1 time: 0.198439 Aug 05 20:49:20.331714 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 340/716] 10.222.0.100 () {58 vars in 1421 bytes} [Fri Aug 5 20:49:20 2022] DELETE /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments/1cd0caf0-9f6b-44ee-83cb-7afe693758fd => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:49:20.341936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0a997fd5-2b7e-47b7-9d86-7e4364b1f9e6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:20.344284 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0a997fd5-2b7e-47b7-9d86-7e4364b1f9e6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:20.347528 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d88dd360-da86-4c01-8193-ff0103a703f8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:20.350667 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0a997fd5-2b7e-47b7-9d86-7e4364b1f9e6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:20.351157 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0a997fd5-2b7e-47b7-9d86-7e4364b1f9e6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:20.351691 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0a997fd5-2b7e-47b7-9d86-7e4364b1f9e6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:20.353062 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0a997fd5-2b7e-47b7-9d86-7e4364b1f9e6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:20.353565 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0a997fd5-2b7e-47b7-9d86-7e4364b1f9e6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:20.353996 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0a997fd5-2b7e-47b7-9d86-7e4364b1f9e6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:20.356883 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d88dd360-da86-4c01-8193-ff0103a703f8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1686 microversion: 2.1 time: 0.162545 Aug 05 20:49:20.357531 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 377/717] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:20 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:20.397359 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0a997fd5-2b7e-47b7-9d86-7e4364b1f9e6 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061081 Aug 05 20:49:20.397913 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 341/718] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:49:20 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:49:20.607670 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-f4d1b2f5-57bd-468e-b329-47e645966bfd req-39a538bc-abeb-47c0-b769-931f9a6eb9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a270d6db-218c-4081-81b9-b161dc70a7bb", "tag": "ff5e6ab7-ec2b-46dd-b050-f4b9bceff071"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:20.618206 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-f4d1b2f5-57bd-468e-b329-47e645966bfd req-39a538bc-abeb-47c0-b769-931f9a6eb9b4 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:20.618731 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-f4d1b2f5-57bd-468e-b329-47e645966bfd req-39a538bc-abeb-47c0-b769-931f9a6eb9b4 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:20.619169 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-f4d1b2f5-57bd-468e-b329-47e645966bfd req-39a538bc-abeb-47c0-b769-931f9a6eb9b4 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:20.631626 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-f4d1b2f5-57bd-468e-b329-47e645966bfd req-39a538bc-abeb-47c0-b769-931f9a6eb9b4 service nova] Creating event network-changed:ff5e6ab7-ec2b-46dd-b050-f4b9bceff071 for instance a270d6db-218c-4081-81b9-b161dc70a7bb on hv-cinder-85220 Aug 05 20:49:20.637180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-f4d1b2f5-57bd-468e-b329-47e645966bfd req-39a538bc-abeb-47c0-b769-931f9a6eb9b4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033401 Aug 05 20:49:20.638121 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 378/719] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:20.931736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c5ecf0e8-b6d4-44bd-99d1-4405b1dcffe8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:20.932360 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c5ecf0e8-b6d4-44bd-99d1-4405b1dcffe8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:20.939276 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c5ecf0e8-b6d4-44bd-99d1-4405b1dcffe8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:20.939935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c5ecf0e8-b6d4-44bd-99d1-4405b1dcffe8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:20.942023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c5ecf0e8-b6d4-44bd-99d1-4405b1dcffe8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:20.942023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c5ecf0e8-b6d4-44bd-99d1-4405b1dcffe8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:20.942023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c5ecf0e8-b6d4-44bd-99d1-4405b1dcffe8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:20.942023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c5ecf0e8-b6d4-44bd-99d1-4405b1dcffe8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:21.081368 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c5ecf0e8-b6d4-44bd-99d1-4405b1dcffe8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:21.090765 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c5ecf0e8-b6d4-44bd-99d1-4405b1dcffe8 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1718 microversion: 2.1 time: 0.164177 Aug 05 20:49:21.095410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 342/720] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:20 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:21.213259 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-52040803-0be3-49f1-b4f6-d85733e6b476 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:21.214098 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-52040803-0be3-49f1-b4f6-d85733e6b476 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:21.220826 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52040803-0be3-49f1-b4f6-d85733e6b476 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:21.221402 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52040803-0be3-49f1-b4f6-d85733e6b476 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:21.221914 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52040803-0be3-49f1-b4f6-d85733e6b476 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:21.222704 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52040803-0be3-49f1-b4f6-d85733e6b476 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:21.223242 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52040803-0be3-49f1-b4f6-d85733e6b476 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:21.223770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52040803-0be3-49f1-b4f6-d85733e6b476 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:21.365130 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-52040803-0be3-49f1-b4f6-d85733e6b476 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] HTTP exception thrown: Cannot 'detach_volume' instance c34d5df9-1498-4fdd-a688-5d8bad899a6f while it is in vm_state rescued Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-52040803-0be3-49f1-b4f6-d85733e6b476 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Request method failure captured: Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments/ce3bbd68-ce90-45c7-8930-427ba6217cbc HTTP/1.1 Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YF2IfsRUiZL8M7nD-mEoyeG9Rq0E23WMw4I16wHL0z90_rs5iFP7YW1fsRcWUvL-Vthi6uNykTnQoJHrrltziloH00ABGq52tY5SvfKLfx_4LqwaAb5lb3uNmD6zXxhShPue3pn6u4DtQuST4mvgSVDuYoAY6Cg1vyAFtoIP0Z3_Jc Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 80b5e8457f2d47b7a7c0d2856a513b77 Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:49:21.366831 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:49:21.368794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_80b5e8457f2d47b7a7c0d2856a513b77", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:49:21.368794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:49:21.368794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 80b5e8457f2d47b7a7c0d2856a513b77 Aug 05 20:49:21.368794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:49:21.368794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-ServerRescueNegativeTestJSON-566068597-project Aug 05 20:49:21.368794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:49:21.368794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:49:21.368794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 2a09fb7dd7ec47e5b37d533c3701a3a2 Aug 05 20:49:21.368794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-566068597-project Aug 05 20:49:21.368794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:49:21.368794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Cannot 'detach_volume' instance c34d5df9-1498-4fdd-a688-5d8bad899a6f while it is in vm_state rescued Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'server_id': 'c34d5df9-1498-4fdd-a688-5d8bad899a6f', 'id': 'ce3bbd68-ce90-45c7-8930-427ba6217cbc'} Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c34d5df9-1498-4fdd-a688-5d8bad899a6f in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:49:21.370526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c34d5df9-1498-4fdd-a688-5d8bad899a6f while it is in vm_state rescued Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c34d5df9-1498-4fdd-a688-5d8bad899a6f while it is in vm_state rescued Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:21.371980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-52040803-0be3-49f1-b4f6-d85733e6b476 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Returning 409 to user: Cannot 'detach_volume' instance c34d5df9-1498-4fdd-a688-5d8bad899a6f while it is in vm_state rescued {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:49:21.373036 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-52040803-0be3-49f1-b4f6-d85733e6b476 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments/ce3bbd68-ce90-45c7-8930-427ba6217cbc" status: 409 len: 152 microversion: 2.1 time: 0.160362 Aug 05 20:49:21.373036 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 379/721] 10.222.0.100 () {58 vars in 1421 bytes} [Fri Aug 5 20:49:21 2022] DELETE /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments/ce3bbd68-ce90-45c7-8930-427ba6217cbc => generated 152 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 05 20:49:21.377566 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8890f924-3a0d-48d1-81e5-a586bafacb2e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:21.377984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ea2d6a28-68f4-4a70-a803-70ccb835880e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:21.378109 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8890f924-3a0d-48d1-81e5-a586bafacb2e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:21.378601 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ea2d6a28-68f4-4a70-a803-70ccb835880e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:21.384276 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8890f924-3a0d-48d1-81e5-a586bafacb2e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:21.384645 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ea2d6a28-68f4-4a70-a803-70ccb835880e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:21.384782 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8890f924-3a0d-48d1-81e5-a586bafacb2e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:21.385133 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ea2d6a28-68f4-4a70-a803-70ccb835880e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:21.385233 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8890f924-3a0d-48d1-81e5-a586bafacb2e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:21.385567 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ea2d6a28-68f4-4a70-a803-70ccb835880e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:21.385847 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8890f924-3a0d-48d1-81e5-a586bafacb2e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:21.386260 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ea2d6a28-68f4-4a70-a803-70ccb835880e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:21.386359 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8890f924-3a0d-48d1-81e5-a586bafacb2e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:21.386694 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8890f924-3a0d-48d1-81e5-a586bafacb2e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:21.386793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ea2d6a28-68f4-4a70-a803-70ccb835880e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:21.387120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ea2d6a28-68f4-4a70-a803-70ccb835880e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:21.467816 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8890f924-3a0d-48d1-81e5-a586bafacb2e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "POST /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/action" status: 202 len: 0 microversion: 2.1 time: 0.093724 Aug 05 20:49:21.468761 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 343/722] 10.222.0.100 () {60 vars in 1283 bytes} [Fri Aug 5 20:49:21 2022] POST /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:49:21.479192 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-5dbd1b99-08df-4cb0-89a3-2687ced598ee tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:21.481944 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-5dbd1b99-08df-4cb0-89a3-2687ced598ee tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:21.488881 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5dbd1b99-08df-4cb0-89a3-2687ced598ee tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:21.489467 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5dbd1b99-08df-4cb0-89a3-2687ced598ee tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:21.489908 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5dbd1b99-08df-4cb0-89a3-2687ced598ee tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:21.490617 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5dbd1b99-08df-4cb0-89a3-2687ced598ee tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:21.491080 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5dbd1b99-08df-4cb0-89a3-2687ced598ee tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:21.491513 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5dbd1b99-08df-4cb0-89a3-2687ced598ee tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:21.516982 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:21.521726 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-5dbd1b99-08df-4cb0-89a3-2687ced598ee tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047868 Aug 05 20:49:21.522318 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 344/723] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:49:21 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:21.527693 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-25aafc20-c6a8-49e5-9115-3919c026b557 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:21.528299 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-25aafc20-c6a8-49e5-9115-3919c026b557 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:21.530638 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ea2d6a28-68f4-4a70-a803-70ccb835880e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:21.534664 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-25aafc20-c6a8-49e5-9115-3919c026b557 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:21.535154 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-25aafc20-c6a8-49e5-9115-3919c026b557 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:21.535691 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-25aafc20-c6a8-49e5-9115-3919c026b557 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:21.536723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-25aafc20-c6a8-49e5-9115-3919c026b557 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:21.537183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-25aafc20-c6a8-49e5-9115-3919c026b557 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:21.537611 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-25aafc20-c6a8-49e5-9115-3919c026b557 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:21.538752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ea2d6a28-68f4-4a70-a803-70ccb835880e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1686 microversion: 2.1 time: 0.164368 Aug 05 20:49:21.539344 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 380/724] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:21 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:21.678846 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-25aafc20-c6a8-49e5-9115-3919c026b557 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:21.687453 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-25aafc20-c6a8-49e5-9115-3919c026b557 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1726 microversion: 2.1 time: 0.164123 Aug 05 20:49:21.688033 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 345/725] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:21 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:22.539070 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6230ce17-7ac0-4d6a-ac0b-5c3b416de3ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:22.541671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6230ce17-7ac0-4d6a-ac0b-5c3b416de3ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:22.548617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6230ce17-7ac0-4d6a-ac0b-5c3b416de3ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:22.549106 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6230ce17-7ac0-4d6a-ac0b-5c3b416de3ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:22.549539 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6230ce17-7ac0-4d6a-ac0b-5c3b416de3ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:22.550315 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6230ce17-7ac0-4d6a-ac0b-5c3b416de3ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:22.550766 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6230ce17-7ac0-4d6a-ac0b-5c3b416de3ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:22.551195 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6230ce17-7ac0-4d6a-ac0b-5c3b416de3ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:22.560855 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-b3cad1b8-952e-4f61-9c9c-4f098e34b9b3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:22.561592 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-b3cad1b8-952e-4f61-9c9c-4f098e34b9b3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:22.568665 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b3cad1b8-952e-4f61-9c9c-4f098e34b9b3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:22.569160 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b3cad1b8-952e-4f61-9c9c-4f098e34b9b3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:22.569601 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b3cad1b8-952e-4f61-9c9c-4f098e34b9b3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:22.570309 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b3cad1b8-952e-4f61-9c9c-4f098e34b9b3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:22.570844 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b3cad1b8-952e-4f61-9c9c-4f098e34b9b3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:22.571274 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b3cad1b8-952e-4f61-9c9c-4f098e34b9b3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:22.581379 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6230ce17-7ac0-4d6a-ac0b-5c3b416de3ff tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049143 Aug 05 20:49:22.582127 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 381/726] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:49:22 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:22.705754 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-b3cad1b8-952e-4f61-9c9c-4f098e34b9b3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:22.709720 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1805ad63-8384-4c40-92eb-b3d6c45357dc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:22.710394 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1805ad63-8384-4c40-92eb-b3d6c45357dc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:22.714349 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-b3cad1b8-952e-4f61-9c9c-4f098e34b9b3 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1686 microversion: 2.1 time: 0.157478 Aug 05 20:49:22.714950 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 346/727] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:22 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:22.721302 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1805ad63-8384-4c40-92eb-b3d6c45357dc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:22.722871 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1805ad63-8384-4c40-92eb-b3d6c45357dc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:22.722871 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1805ad63-8384-4c40-92eb-b3d6c45357dc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:22.723165 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1805ad63-8384-4c40-92eb-b3d6c45357dc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:22.723510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1805ad63-8384-4c40-92eb-b3d6c45357dc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:22.723953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1805ad63-8384-4c40-92eb-b3d6c45357dc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:22.980989 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1805ad63-8384-4c40-92eb-b3d6c45357dc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:22.991202 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1805ad63-8384-4c40-92eb-b3d6c45357dc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1726 microversion: 2.1 time: 0.284764 Aug 05 20:49:22.991202 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 382/728] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:22 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1726 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:23.594179 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-431f8fb6-0b36-4340-bd5b-d15278ddc268 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:23.596576 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-431f8fb6-0b36-4340-bd5b-d15278ddc268 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:23.604125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-431f8fb6-0b36-4340-bd5b-d15278ddc268 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:23.604617 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-431f8fb6-0b36-4340-bd5b-d15278ddc268 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:23.605050 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-431f8fb6-0b36-4340-bd5b-d15278ddc268 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:23.605784 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-431f8fb6-0b36-4340-bd5b-d15278ddc268 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:23.606231 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-431f8fb6-0b36-4340-bd5b-d15278ddc268 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:23.606876 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-431f8fb6-0b36-4340-bd5b-d15278ddc268 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:23.640678 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-431f8fb6-0b36-4340-bd5b-d15278ddc268 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050461 Aug 05 20:49:23.641155 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 347/729] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:49:23 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:49:23.652043 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2f8e255e-e0a6-42d6-bb95-ec50ba09cf20 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:23.652942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2f8e255e-e0a6-42d6-bb95-ec50ba09cf20 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:23.659534 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f8e255e-e0a6-42d6-bb95-ec50ba09cf20 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:23.660021 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f8e255e-e0a6-42d6-bb95-ec50ba09cf20 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:23.660452 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f8e255e-e0a6-42d6-bb95-ec50ba09cf20 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:23.661149 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f8e255e-e0a6-42d6-bb95-ec50ba09cf20 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:23.661595 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f8e255e-e0a6-42d6-bb95-ec50ba09cf20 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:23.662022 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f8e255e-e0a6-42d6-bb95-ec50ba09cf20 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:23.736197 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0ab4c0df-352c-40f5-824a-65f6ca9587ec tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:23.736899 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0ab4c0df-352c-40f5-824a-65f6ca9587ec tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:23.740048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-2f8e255e-e0a6-42d6-bb95-ec50ba09cf20 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] HTTP exception thrown: Instance a270d6db-218c-4081-81b9-b161dc70a7bb is not attached to volume 1cd0caf0-9f6b-44ee-83cb-7afe693758fd Aug 05 20:49:23.744191 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0ab4c0df-352c-40f5-824a-65f6ca9587ec tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:23.744679 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0ab4c0df-352c-40f5-824a-65f6ca9587ec tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:23.745104 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0ab4c0df-352c-40f5-824a-65f6ca9587ec tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:23.745798 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0ab4c0df-352c-40f5-824a-65f6ca9587ec tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:23.746241 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0ab4c0df-352c-40f5-824a-65f6ca9587ec tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:23.746655 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0ab4c0df-352c-40f5-824a-65f6ca9587ec tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2f8e255e-e0a6-42d6-bb95-ec50ba09cf20 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Request method failure captured: Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments/1cd0caf0-9f6b-44ee-83cb-7afe693758fd HTTP/1.1 Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YF0tHMuDhV_8HWA7U0JnrGcI1X3ht9BLQ8lC5CGjybMcPtzYWJiCrby8lAs8PFAVnVsQi46QPUWxuQNvM9XFunfI_nLzXtWgiQkpRZ524BBr25J151P3XJRT5muCfMmUxTwQ3_ZunyhjSki8w2anfq_owYHB1W9RRheS5q2vH_apuE Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 958a479cb6904c1bb6e6868c2b061e02 Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-TestMinimumBasicScenario-1541283101 Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:49:23.752457 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:49:23.753941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/958a479cb6904c1bb6e6868c2b061e02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/958a479cb6904c1bb6e6868c2b061e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/958a479cb6904c1bb6e6868c2b061e02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_958a479cb6904c1bb6e6868c2b061e02", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:49:23.753941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-TestMinimumBasicScenario-1541283101 Aug 05 20:49:23.753941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 958a479cb6904c1bb6e6868c2b061e02 Aug 05 20:49:23.753941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1541283101 Aug 05 20:49:23.753941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-TestMinimumBasicScenario-1541283101-project Aug 05 20:49:23.753941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:49:23.753941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:49:23.753941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 30986eb76c6d4434b9c92f26d8418fbb Aug 05 20:49:23.753941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-TestMinimumBasicScenario-1541283101-project Aug 05 20:49:23.753941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:49:23.753941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance a270d6db-218c-4081-81b9-b161dc70a7bb is not attached to volume 1cd0caf0-9f6b-44ee-83cb-7afe693758fd Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'server_id': 'a270d6db-218c-4081-81b9-b161dc70a7bb', 'id': '1cd0caf0-9f6b-44ee-83cb-7afe693758fd'} Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1cd0caf0-9f6b-44ee-83cb-7afe693758fd. Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:49:23.754768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a270d6db-218c-4081-81b9-b161dc70a7bb is not attached to volume 1cd0caf0-9f6b-44ee-83cb-7afe693758fd Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a270d6db-218c-4081-81b9-b161dc70a7bb is not attached to volume 1cd0caf0-9f6b-44ee-83cb-7afe693758fd Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:23.756146 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2f8e255e-e0a6-42d6-bb95-ec50ba09cf20 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Returning 404 to user: Instance a270d6db-218c-4081-81b9-b161dc70a7bb is not attached to volume 1cd0caf0-9f6b-44ee-83cb-7afe693758fd {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:49:23.757204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2f8e255e-e0a6-42d6-bb95-ec50ba09cf20 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments/1cd0caf0-9f6b-44ee-83cb-7afe693758fd" status: 404 len: 154 microversion: 2.1 time: 0.108784 Aug 05 20:49:23.758085 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 383/730] 10.222.0.100 () {58 vars in 1421 bytes} [Fri Aug 5 20:49:23 2022] DELETE /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb/os-volume_attachments/1cd0caf0-9f6b-44ee-83cb-7afe693758fd => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:49:24.011789 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d32b022b-ca78-43b2-a151-0d49d1d0f30c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:24.012503 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d32b022b-ca78-43b2-a151-0d49d1d0f30c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:24.018878 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d32b022b-ca78-43b2-a151-0d49d1d0f30c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:24.019407 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d32b022b-ca78-43b2-a151-0d49d1d0f30c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:24.019890 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d32b022b-ca78-43b2-a151-0d49d1d0f30c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:24.020629 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d32b022b-ca78-43b2-a151-0d49d1d0f30c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:24.021140 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d32b022b-ca78-43b2-a151-0d49d1d0f30c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:24.021588 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d32b022b-ca78-43b2-a151-0d49d1d0f30c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:24.061637 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0ab4c0df-352c-40f5-824a-65f6ca9587ec tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:24.076881 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0ab4c0df-352c-40f5-824a-65f6ca9587ec tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1686 microversion: 2.1 time: 0.344820 Aug 05 20:49:24.078142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 348/731] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:23 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1686 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:24.229546 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d32b022b-ca78-43b2-a151-0d49d1d0f30c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:24.240341 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d32b022b-ca78-43b2-a151-0d49d1d0f30c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1726 microversion: 2.1 time: 0.232695 Aug 05 20:49:24.240927 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 384/732] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:24 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1726 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:24.510089 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-4c4c5a77-75e2-462f-82c0-f147cb386c42 req-5a5229eb-ad65-4969-80ef-77c73e831002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a70e3c-12e4-4459-b22d-b9152f1987c1", "name": "network-vif-deleted", "tag": "7ee68135-83de-4b1e-a4b4-40f2021dc25f"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:24.519700 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-4c4c5a77-75e2-462f-82c0-f147cb386c42 req-5a5229eb-ad65-4969-80ef-77c73e831002 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:24.520177 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-4c4c5a77-75e2-462f-82c0-f147cb386c42 req-5a5229eb-ad65-4969-80ef-77c73e831002 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:24.520715 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-4c4c5a77-75e2-462f-82c0-f147cb386c42 req-5a5229eb-ad65-4969-80ef-77c73e831002 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:24.532915 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-4c4c5a77-75e2-462f-82c0-f147cb386c42 req-5a5229eb-ad65-4969-80ef-77c73e831002 service nova] Creating event network-vif-deleted:7ee68135-83de-4b1e-a4b4-40f2021dc25f for instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 on hv-cinder-85220 Aug 05 20:49:24.538028 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-4c4c5a77-75e2-462f-82c0-f147cb386c42 req-5a5229eb-ad65-4969-80ef-77c73e831002 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031707 Aug 05 20:49:24.539013 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 349/733] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:24.909935 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-222f6d04-9d81-4061-a306-0c0047a01b9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:24.910447 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-222f6d04-9d81-4061-a306-0c0047a01b9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:24.917678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-222f6d04-9d81-4061-a306-0c0047a01b9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:24.918239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-222f6d04-9d81-4061-a306-0c0047a01b9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:24.918763 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-222f6d04-9d81-4061-a306-0c0047a01b9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:24.919560 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-222f6d04-9d81-4061-a306-0c0047a01b9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:24.920014 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-222f6d04-9d81-4061-a306-0c0047a01b9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:24.920549 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-222f6d04-9d81-4061-a306-0c0047a01b9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:24.946671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-222f6d04-9d81-4061-a306-0c0047a01b9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:49:24.948668 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:25.031183 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-222f6d04-9d81-4061-a306-0c0047a01b9b tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 204 len: 0 microversion: 2.1 time: 0.124912 Aug 05 20:49:25.031817 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 385/734] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:49:24 2022] DELETE /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:49:25.041921 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c296b3f6-3769-4616-8a80-8e376347916c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:25.042660 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c296b3f6-3769-4616-8a80-8e376347916c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:25.048869 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c296b3f6-3769-4616-8a80-8e376347916c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:25.049367 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c296b3f6-3769-4616-8a80-8e376347916c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:25.049800 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c296b3f6-3769-4616-8a80-8e376347916c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:25.050493 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c296b3f6-3769-4616-8a80-8e376347916c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:25.050942 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c296b3f6-3769-4616-8a80-8e376347916c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:25.051385 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c296b3f6-3769-4616-8a80-8e376347916c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:25.098992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e5319d86-47dc-4986-a612-5ee315e21583 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:25.100026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e5319d86-47dc-4986-a612-5ee315e21583 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:25.106485 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e5319d86-47dc-4986-a612-5ee315e21583 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:25.107059 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e5319d86-47dc-4986-a612-5ee315e21583 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:25.107751 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e5319d86-47dc-4986-a612-5ee315e21583 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:25.108551 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e5319d86-47dc-4986-a612-5ee315e21583 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:25.109072 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e5319d86-47dc-4986-a612-5ee315e21583 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:25.109595 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e5319d86-47dc-4986-a612-5ee315e21583 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:25.193681 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e5319d86-47dc-4986-a612-5ee315e21583 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:25.204097 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e5319d86-47dc-4986-a612-5ee315e21583 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1618 microversion: 2.1 time: 0.109388 Aug 05 20:49:25.204921 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 386/735] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:25 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1618 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:25.217611 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c296b3f6-3769-4616-8a80-8e376347916c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:25.225746 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c296b3f6-3769-4616-8a80-8e376347916c tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1557 microversion: 2.1 time: 0.189165 Aug 05 20:49:25.226292 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 350/736] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:25 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1557 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:25.262201 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c433b6db-8fb4-421b-85b2-86313fb2a231 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:25.262908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c433b6db-8fb4-421b-85b2-86313fb2a231 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:25.269260 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c433b6db-8fb4-421b-85b2-86313fb2a231 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:25.269738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c433b6db-8fb4-421b-85b2-86313fb2a231 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:25.270163 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c433b6db-8fb4-421b-85b2-86313fb2a231 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:25.270847 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c433b6db-8fb4-421b-85b2-86313fb2a231 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:25.271292 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c433b6db-8fb4-421b-85b2-86313fb2a231 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:25.271732 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c433b6db-8fb4-421b-85b2-86313fb2a231 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:25.430817 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c433b6db-8fb4-421b-85b2-86313fb2a231 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:25.439069 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c433b6db-8fb4-421b-85b2-86313fb2a231 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1726 microversion: 2.1 time: 0.180816 Aug 05 20:49:25.439742 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 387/737] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:25 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:26.228882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c428afc2-48ac-48ac-ac23-94737c8509c6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:26.229496 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c428afc2-48ac-48ac-ac23-94737c8509c6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:26.237076 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c428afc2-48ac-48ac-ac23-94737c8509c6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:26.237563 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c428afc2-48ac-48ac-ac23-94737c8509c6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:26.238003 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c428afc2-48ac-48ac-ac23-94737c8509c6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:26.238724 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c428afc2-48ac-48ac-ac23-94737c8509c6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:26.239192 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c428afc2-48ac-48ac-ac23-94737c8509c6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:26.239728 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c428afc2-48ac-48ac-ac23-94737c8509c6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:26.248282 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-95ca2131-4143-4161-b791-f4be0cb9e0df tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:26.248897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-95ca2131-4143-4161-b791-f4be0cb9e0df tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:26.256061 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95ca2131-4143-4161-b791-f4be0cb9e0df tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:26.256624 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95ca2131-4143-4161-b791-f4be0cb9e0df tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:26.257064 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95ca2131-4143-4161-b791-f4be0cb9e0df tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:26.257773 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95ca2131-4143-4161-b791-f4be0cb9e0df tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:26.258507 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95ca2131-4143-4161-b791-f4be0cb9e0df tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:26.259098 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95ca2131-4143-4161-b791-f4be0cb9e0df tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:26.324178 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c428afc2-48ac-48ac-ac23-94737c8509c6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:26.332814 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c428afc2-48ac-48ac-ac23-94737c8509c6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1331 microversion: 2.1 time: 0.109380 Aug 05 20:49:26.333734 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 351/738] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:26 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:26.433086 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-95ca2131-4143-4161-b791-f4be0cb9e0df tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:26.443928 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-95ca2131-4143-4161-b791-f4be0cb9e0df tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1557 microversion: 2.1 time: 0.201149 Aug 05 20:49:26.444741 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 388/739] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:26 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1557 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:26.465886 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a6a8a1eb-46f1-4b26-a069-b54407ce2a07 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:26.466490 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a6a8a1eb-46f1-4b26-a069-b54407ce2a07 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:26.472878 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a6a8a1eb-46f1-4b26-a069-b54407ce2a07 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:26.473367 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a6a8a1eb-46f1-4b26-a069-b54407ce2a07 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:26.473805 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a6a8a1eb-46f1-4b26-a069-b54407ce2a07 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:26.474495 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a6a8a1eb-46f1-4b26-a069-b54407ce2a07 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:26.474952 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a6a8a1eb-46f1-4b26-a069-b54407ce2a07 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:26.475383 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a6a8a1eb-46f1-4b26-a069-b54407ce2a07 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:26.614812 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a6a8a1eb-46f1-4b26-a069-b54407ce2a07 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:26.623573 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a6a8a1eb-46f1-4b26-a069-b54407ce2a07 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1726 microversion: 2.1 time: 0.161422 Aug 05 20:49:26.624190 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 352/740] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:26 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:27.358153 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a8f7e54a-8ea2-46f1-bcdd-59cc405fe351 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:27.358691 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a8f7e54a-8ea2-46f1-bcdd-59cc405fe351 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:27.366505 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8f7e54a-8ea2-46f1-bcdd-59cc405fe351 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:27.367322 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8f7e54a-8ea2-46f1-bcdd-59cc405fe351 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:27.367884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8f7e54a-8ea2-46f1-bcdd-59cc405fe351 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:27.368572 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8f7e54a-8ea2-46f1-bcdd-59cc405fe351 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:27.369015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8f7e54a-8ea2-46f1-bcdd-59cc405fe351 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:27.369436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a8f7e54a-8ea2-46f1-bcdd-59cc405fe351 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:27.437610 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a8f7e54a-8ea2-46f1-bcdd-59cc405fe351 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:27.445282 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a8f7e54a-8ea2-46f1-bcdd-59cc405fe351 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 200 len: 1331 microversion: 2.1 time: 0.092976 Aug 05 20:49:27.446131 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 389/741] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:27 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:27.467538 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c2e9f311-0556-454a-bdaf-59e0473ab61f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:27.468144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c2e9f311-0556-454a-bdaf-59e0473ab61f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:27.477805 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2e9f311-0556-454a-bdaf-59e0473ab61f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:27.478438 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2e9f311-0556-454a-bdaf-59e0473ab61f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:27.479125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2e9f311-0556-454a-bdaf-59e0473ab61f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:27.480214 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2e9f311-0556-454a-bdaf-59e0473ab61f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:27.480748 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2e9f311-0556-454a-bdaf-59e0473ab61f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:27.481216 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c2e9f311-0556-454a-bdaf-59e0473ab61f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:27.625812 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c2e9f311-0556-454a-bdaf-59e0473ab61f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:27.633856 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c2e9f311-0556-454a-bdaf-59e0473ab61f tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1557 microversion: 2.1 time: 0.172100 Aug 05 20:49:27.634477 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 353/742] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:27 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1557 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:27.645130 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-938034df-a707-4244-b79a-428ae22b3c74 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:27.645780 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-938034df-a707-4244-b79a-428ae22b3c74 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:27.652725 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-938034df-a707-4244-b79a-428ae22b3c74 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:27.653219 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-938034df-a707-4244-b79a-428ae22b3c74 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:27.653661 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-938034df-a707-4244-b79a-428ae22b3c74 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:27.654359 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-938034df-a707-4244-b79a-428ae22b3c74 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:27.654817 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-938034df-a707-4244-b79a-428ae22b3c74 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:27.655247 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-938034df-a707-4244-b79a-428ae22b3c74 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:27.795953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-938034df-a707-4244-b79a-428ae22b3c74 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:27.804801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-938034df-a707-4244-b79a-428ae22b3c74 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1732 microversion: 2.1 time: 0.163664 Aug 05 20:49:27.806003 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 390/743] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:27 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:27.831914 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-2f414c62-952b-4e7e-8056-dd0391c5e590 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:27.832396 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-2f414c62-952b-4e7e-8056-dd0391c5e590 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:27.839091 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f414c62-952b-4e7e-8056-dd0391c5e590 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:27.839605 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f414c62-952b-4e7e-8056-dd0391c5e590 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:27.840033 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f414c62-952b-4e7e-8056-dd0391c5e590 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:27.840719 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f414c62-952b-4e7e-8056-dd0391c5e590 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:27.841191 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f414c62-952b-4e7e-8056-dd0391c5e590 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:27.841616 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f414c62-952b-4e7e-8056-dd0391c5e590 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:27.927103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-2f414c62-952b-4e7e-8056-dd0391c5e590 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098684 Aug 05 20:49:27.927837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 354/744] 10.222.0.100 () {58 vars in 1280 bytes} [Fri Aug 5 20:49:27 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:28.470599 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-af11aaec-da33-403d-8628-fec13b9c555d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:28.471436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-af11aaec-da33-403d-8628-fec13b9c555d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:28.478555 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af11aaec-da33-403d-8628-fec13b9c555d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:28.478966 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af11aaec-da33-403d-8628-fec13b9c555d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:28.479430 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af11aaec-da33-403d-8628-fec13b9c555d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:28.480375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af11aaec-da33-403d-8628-fec13b9c555d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:28.480829 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af11aaec-da33-403d-8628-fec13b9c555d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:28.481251 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-af11aaec-da33-403d-8628-fec13b9c555d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:28.495504 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-af11aaec-da33-403d-8628-fec13b9c555d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] HTTP exception thrown: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-af11aaec-da33-403d-8628-fec13b9c555d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Request method failure captured: Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 HTTP/1.1 Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEVT2RIo0sOYhrqEh_HYIhCXXgNEIU5O2TrKSb8O78pPQouV0XDBbsdQswVZsYX73wXTNNa6pCEJklCAufLFYW63yx7CPEVZ0Ry2Y0Ikjromqqlux7d4-wF_GlTFyol_iESoMY4-E-LXutqB0V3ogXtBOvhKaWzWfUtI3jvN-kS_PY Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:49:28.497297 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:49:28.498793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8b67138a484f481099c562d7e3ca8401", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:49:28.498793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:49:28.498793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:49:28.498793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:49:28.498793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:49:28.498793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:49:28.498793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:49:28.498793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 8e1baad75342476aa0c64bda0414e334 Aug 05 20:49:28.498793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:49:28.498793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:49:28.498793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:49:28.498793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '26a70e3c-12e4-4459-b22d-b9152f1987c1'} Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:49:28.499715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:49:28.501285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:28.502846 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-af11aaec-da33-403d-8628-fec13b9c555d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Returning 404 to user: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:49:28.502846 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-af11aaec-da33-403d-8628-fec13b9c555d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 404 len: 111 microversion: 2.1 time: 0.033408 Aug 05 20:49:28.508546 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8f1f0996-123c-4274-a9c0-f6f5918d6880 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '.version_select at 0x7f9be763c940>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:28.513028 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 391/745] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:28 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:49:28.530002 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8f1f0996-123c-4274-a9c0-f6f5918d6880 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641989337" status: 202 len: 0 microversion: 2.1 time: 0.026006 Aug 05 20:49:28.530585 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 355/746] 10.222.0.100 () {58 vars in 1226 bytes} [Fri Aug 5 20:49:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641989337 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:49:28.655266 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c7e80d47-0a2c-402c-874c-6692e6f74d87 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:28.655876 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c7e80d47-0a2c-402c-874c-6692e6f74d87 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:28.662466 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7e80d47-0a2c-402c-874c-6692e6f74d87 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:28.662963 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7e80d47-0a2c-402c-874c-6692e6f74d87 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:28.663416 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7e80d47-0a2c-402c-874c-6692e6f74d87 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:28.664562 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7e80d47-0a2c-402c-874c-6692e6f74d87 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:28.665356 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7e80d47-0a2c-402c-874c-6692e6f74d87 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:28.665782 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7e80d47-0a2c-402c-874c-6692e6f74d87 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:28.952866 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c7e80d47-0a2c-402c-874c-6692e6f74d87 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30986eb76c6d4434b9c92f26d8418fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958a479cb6904c1bb6e6868c2b061e02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:28.964828 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c7e80d47-0a2c-402c-874c-6692e6f74d87 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 200 len: 1557 microversion: 2.1 time: 0.313681 Aug 05 20:49:28.980876 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 392/747] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:28 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 1557 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:49:29.205734 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-aa4e6a46-801f-4cd6-a89f-59b2837eb921 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Action: 'create', calling method: .version_select at 0x7f9be754d280>, body: {"keypair": {"name": "tempest-keypair-759215415", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLBxtGbF+FzPalmafsbB3jqwx/3Z5anMsOG8xsuBlc79csA6xb+i/5A7o5l9gphy8AOXbj85BFIH4oMECNTDzaCRjB283ewjKmm40RiKdIfOu5bGqMvJjRk5uB76c7tnw=="}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:29.224040 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-aa4e6a46-801f-4cd6-a89f-59b2837eb921 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for project 8b67138a484f481099c562d7e3ca8401. Resources: {'key_pairs'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:49:29.228378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-f8edc67c-ab25-4658-8d5b-d7b988e36656 req-89b5291b-99f3-4ad6-b014-b498ae54fa42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a270d6db-218c-4081-81b9-b161dc70a7bb", "name": "network-vif-deleted", "tag": "ff5e6ab7-ec2b-46dd-b050-f4b9bceff071"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:29.228556 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-aa4e6a46-801f-4cd6-a89f-59b2837eb921 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for user 8e1baad75342476aa0c64bda0414e334 and project 8b67138a484f481099c562d7e3ca8401. Resources: {'key_pairs'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:49:29.239475 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-f8edc67c-ab25-4658-8d5b-d7b988e36656 req-89b5291b-99f3-4ad6-b014-b498ae54fa42 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:29.240353 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-f8edc67c-ab25-4658-8d5b-d7b988e36656 req-89b5291b-99f3-4ad6-b014-b498ae54fa42 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:29.240944 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-f8edc67c-ab25-4658-8d5b-d7b988e36656 req-89b5291b-99f3-4ad6-b014-b498ae54fa42 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:29.253997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-f8edc67c-ab25-4658-8d5b-d7b988e36656 req-89b5291b-99f3-4ad6-b014-b498ae54fa42 service nova] Creating event network-vif-deleted:ff5e6ab7-ec2b-46dd-b050-f4b9bceff071 for instance a270d6db-218c-4081-81b9-b161dc70a7bb on hv-cinder-85220 Aug 05 20:49:29.254340 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:29.261841 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-f8edc67c-ab25-4658-8d5b-d7b988e36656 req-89b5291b-99f3-4ad6-b014-b498ae54fa42 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038635 Aug 05 20:49:29.263321 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 393/748] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:29.266241 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-aa4e6a46-801f-4cd6-a89f-59b2837eb921 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064827 Aug 05 20:49:29.266847 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 356/749] 10.222.0.100 () {60 vars in 1164 bytes} [Fri Aug 5 20:49:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:29.988016 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-90c1c334-ad1a-4cbb-9558-660e1ad5b3b4 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:29.988805 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-90c1c334-ad1a-4cbb-9558-660e1ad5b3b4 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] [instance: a270d6db-218c-4081-81b9-b161dc70a7bb] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:29.995123 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-90c1c334-ad1a-4cbb-9558-660e1ad5b3b4 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:29.995752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-90c1c334-ad1a-4cbb-9558-660e1ad5b3b4 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:29.996252 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-90c1c334-ad1a-4cbb-9558-660e1ad5b3b4 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:29.997102 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-90c1c334-ad1a-4cbb-9558-660e1ad5b3b4 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:29.997587 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-90c1c334-ad1a-4cbb-9558-660e1ad5b3b4 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:29.998041 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-90c1c334-ad1a-4cbb-9558-660e1ad5b3b4 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:30.013086 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-90c1c334-ad1a-4cbb-9558-660e1ad5b3b4 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] HTTP exception thrown: Instance a270d6db-218c-4081-81b9-b161dc70a7bb could not be found. Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-90c1c334-ad1a-4cbb-9558-660e1ad5b3b4 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Request method failure captured: Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb HTTP/1.1 Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YF0tHMuDhV_8HWA7U0JnrGcI1X3ht9BLQ8lC5CGjybMcPtzYWJiCrby8lAs8PFAVnVsQi46QPUWxuQNvM9XFunfI_nLzXtWgiQkpRZ524BBr25J151P3XJRT5muCfMmUxTwQ3_ZunyhjSki8w2anfq_owYHB1W9RRheS5q2vH_apuE Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 958a479cb6904c1bb6e6868c2b061e02 Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-TestMinimumBasicScenario-1541283101 Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:49:30.014849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:49:30.016487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/958a479cb6904c1bb6e6868c2b061e02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/958a479cb6904c1bb6e6868c2b061e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/958a479cb6904c1bb6e6868c2b061e02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_958a479cb6904c1bb6e6868c2b061e02", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:49:30.016487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-TestMinimumBasicScenario-1541283101 Aug 05 20:49:30.016487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 958a479cb6904c1bb6e6868c2b061e02 Aug 05 20:49:30.016487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1541283101 Aug 05 20:49:30.016487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-TestMinimumBasicScenario-1541283101-project Aug 05 20:49:30.016487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:49:30.016487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:49:30.016487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 30986eb76c6d4434b9c92f26d8418fbb Aug 05 20:49:30.016487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-TestMinimumBasicScenario-1541283101-project Aug 05 20:49:30.016487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:49:30.016487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance a270d6db-218c-4081-81b9-b161dc70a7bb could not be found. Aug 05 20:49:30.016487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': 'a270d6db-218c-4081-81b9-b161dc70a7bb'} Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a270d6db-218c-4081-81b9-b161dc70a7bb could not be found. Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:49:30.017375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a270d6db-218c-4081-81b9-b161dc70a7bb could not be found. Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a270d6db-218c-4081-81b9-b161dc70a7bb could not be found. Aug 05 20:49:30.018800 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:49:30.024151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-90c1c334-ad1a-4cbb-9558-660e1ad5b3b4 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Returning 404 to user: Instance a270d6db-218c-4081-81b9-b161dc70a7bb could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:49:30.024151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-90c1c334-ad1a-4cbb-9558-660e1ad5b3b4 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb" status: 404 len: 111 microversion: 2.1 time: 0.035186 Aug 05 20:49:30.024151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 394/750] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:29 2022] GET /compute/v2.1/servers/a270d6db-218c-4081-81b9-b161dc70a7bb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:49:30.029351 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-eeb19634-17fe-4509-a765-ef27aac90de4 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] Calling method '.version_select at 0x7f9be756ba60>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:30.052331 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-eeb19634-17fe-4509-a765-ef27aac90de4 tempest-TestMinimumBasicScenario-1541283101 tempest-TestMinimumBasicScenario-1541283101-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1345926642" status: 202 len: 0 microversion: 2.1 time: 0.027430 Aug 05 20:49:30.053504 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 357/751] 10.222.0.100 () {58 vars in 1277 bytes} [Fri Aug 5 20:49:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1345926642 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:49:30.691196 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-737310043", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9bbc8caf-4605-4dc8-9bf5-6e59e633b041"}], "security_groups": [{"name": "tempest-securitygroup--1916408762"}], "key_name": "tempest-keypair-759215415", "user_data": "}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:30.797510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] validate_networks() for [('9bbc8caf-4605-4dc8-9bf5-6e59e633b041', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:49:31.220213 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:49:31.220819 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:49:31.221130 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:49:31.221568 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:49:31.221956 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:49:31.231177 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:31.231769 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:31.232208 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:31.232934 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:31.233387 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:31.233814 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:31.251027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for project 8b67138a484f481099c562d7e3ca8401. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:49:31.255379 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Getting quotas for user 8e1baad75342476aa0c64bda0414e334 and project 8b67138a484f481099c562d7e3ca8401. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:49:31.266907 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:49:31.269264 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:49:31.317450 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a0638953-6df8-4fa0-9ade-b0f141099a77 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.630656 Aug 05 20:49:31.318324 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 395/752] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:49:30 2022] POST /compute/v2.1/servers => generated 404 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:49:31.329459 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1fb3dfca-e24b-48c3-a6ae-1660c8505307 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:31.330670 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-1fb3dfca-e24b-48c3-a6ae-1660c8505307 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:31.389761 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-1fb3dfca-e24b-48c3-a6ae-1660c8505307 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:31.403046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-1fb3dfca-e24b-48c3-a6ae-1660c8505307 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1244 microversion: 2.1 time: 0.076427 Aug 05 20:49:31.413701 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 358/753] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:31 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:31.579251 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-b2ca4b75-4aa2-4ac4-a5cd-f5e5db19cb46 req-d2ecd2d4-fba8-4ba7-a915-3dc10863e1dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34d5df9-1498-4fdd-a688-5d8bad899a6f", "tag": "eaa0d3a0-5e0f-465f-ac62-8d0749b1809c"}, {"name": "network-changed", "server_uuid": "c34d5df9-1498-4fdd-a688-5d8bad899a6f", "tag": "eaa0d3a0-5e0f-465f-ac62-8d0749b1809c"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:31.589924 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-b2ca4b75-4aa2-4ac4-a5cd-f5e5db19cb46 req-d2ecd2d4-fba8-4ba7-a915-3dc10863e1dd service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:31.590632 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-b2ca4b75-4aa2-4ac4-a5cd-f5e5db19cb46 req-d2ecd2d4-fba8-4ba7-a915-3dc10863e1dd service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:31.591063 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-b2ca4b75-4aa2-4ac4-a5cd-f5e5db19cb46 req-d2ecd2d4-fba8-4ba7-a915-3dc10863e1dd service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:31.603095 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-b2ca4b75-4aa2-4ac4-a5cd-f5e5db19cb46 req-d2ecd2d4-fba8-4ba7-a915-3dc10863e1dd service nova] Creating event network-changed:eaa0d3a0-5e0f-465f-ac62-8d0749b1809c for instance c34d5df9-1498-4fdd-a688-5d8bad899a6f on hv-cinder-85220 Aug 05 20:49:31.603712 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-b2ca4b75-4aa2-4ac4-a5cd-f5e5db19cb46 req-d2ecd2d4-fba8-4ba7-a915-3dc10863e1dd service nova] Creating event network-changed:eaa0d3a0-5e0f-465f-ac62-8d0749b1809c for instance c34d5df9-1498-4fdd-a688-5d8bad899a6f on hv-cinder-85220 Aug 05 20:49:31.608793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-b2ca4b75-4aa2-4ac4-a5cd-f5e5db19cb46 req-d2ecd2d4-fba8-4ba7-a915-3dc10863e1dd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035802 Aug 05 20:49:31.609551 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 396/754] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:32.428395 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-22068180-6183-45c0-b799-ae2b1c3e7c4e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:32.429024 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-22068180-6183-45c0-b799-ae2b1c3e7c4e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:32.437722 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-22068180-6183-45c0-b799-ae2b1c3e7c4e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:32.438229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-22068180-6183-45c0-b799-ae2b1c3e7c4e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:32.438689 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-22068180-6183-45c0-b799-ae2b1c3e7c4e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:32.439469 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-22068180-6183-45c0-b799-ae2b1c3e7c4e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:32.440087 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-22068180-6183-45c0-b799-ae2b1c3e7c4e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:32.440678 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-22068180-6183-45c0-b799-ae2b1c3e7c4e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:32.515473 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-22068180-6183-45c0-b799-ae2b1c3e7c4e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:32.526575 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-22068180-6183-45c0-b799-ae2b1c3e7c4e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1296 microversion: 2.1 time: 0.103518 Aug 05 20:49:32.528173 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 359/755] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:32 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:32.813086 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f3e185af-dde6-4c36-9bf2-496134d11681 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:32.816591 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f3e185af-dde6-4c36-9bf2-496134d11681 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:32.825257 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f3e185af-dde6-4c36-9bf2-496134d11681 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:32.826111 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f3e185af-dde6-4c36-9bf2-496134d11681 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:32.826811 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f3e185af-dde6-4c36-9bf2-496134d11681 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:32.827789 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f3e185af-dde6-4c36-9bf2-496134d11681 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:32.828459 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f3e185af-dde6-4c36-9bf2-496134d11681 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:32.829218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f3e185af-dde6-4c36-9bf2-496134d11681 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:32.878121 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f3e185af-dde6-4c36-9bf2-496134d11681 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d/ips" status: 200 len: 153 microversion: 2.20 time: 0.163784 Aug 05 20:49:32.879274 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 397/756] 10.222.0.100 () {60 vars in 1294 bytes} [Fri Aug 5 20:49:32 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d/ips => generated 153 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 20:49:33.549091 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-b695167a-631c-4c51-8c99-6ce32f0b6b7b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:33.549666 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-b695167a-631c-4c51-8c99-6ce32f0b6b7b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:33.556612 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b695167a-631c-4c51-8c99-6ce32f0b6b7b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:33.557069 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b695167a-631c-4c51-8c99-6ce32f0b6b7b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:33.557500 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b695167a-631c-4c51-8c99-6ce32f0b6b7b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:33.558211 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b695167a-631c-4c51-8c99-6ce32f0b6b7b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:33.558671 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b695167a-631c-4c51-8c99-6ce32f0b6b7b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:33.559105 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b695167a-631c-4c51-8c99-6ce32f0b6b7b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:33.660080 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-b695167a-631c-4c51-8c99-6ce32f0b6b7b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:33.670324 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-b695167a-631c-4c51-8c99-6ce32f0b6b7b tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1302 microversion: 2.1 time: 0.124423 Aug 05 20:49:33.683373 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 360/757] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:33 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1302 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:34.690566 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-478dfb1c-a922-48d8-91bf-3939abdd1650 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:34.691209 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-478dfb1c-a922-48d8-91bf-3939abdd1650 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:34.698191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-478dfb1c-a922-48d8-91bf-3939abdd1650 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:34.698680 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-478dfb1c-a922-48d8-91bf-3939abdd1650 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:34.699106 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-478dfb1c-a922-48d8-91bf-3939abdd1650 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:34.699832 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-478dfb1c-a922-48d8-91bf-3939abdd1650 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:34.700283 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-478dfb1c-a922-48d8-91bf-3939abdd1650 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:34.700705 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-478dfb1c-a922-48d8-91bf-3939abdd1650 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:34.980140 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-478dfb1c-a922-48d8-91bf-3939abdd1650 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:34.988087 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-478dfb1c-a922-48d8-91bf-3939abdd1650 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1370 microversion: 2.1 time: 0.301507 Aug 05 20:49:34.997541 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 398/758] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:34 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1370 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:35.037944 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-fecc3695-51cc-4baa-b664-ff946c0f7e29 req-3b8dc3d6-aa2e-4ba4-91e0-71c0d714eb73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6304f059-f069-47d9-808f-7546856e6a12", "tag": "61286b42-0dd3-4e59-a3e6-3d50dccc2a6d"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:35.049758 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-fecc3695-51cc-4baa-b664-ff946c0f7e29 req-3b8dc3d6-aa2e-4ba4-91e0-71c0d714eb73 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:35.050247 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-fecc3695-51cc-4baa-b664-ff946c0f7e29 req-3b8dc3d6-aa2e-4ba4-91e0-71c0d714eb73 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:35.050671 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-fecc3695-51cc-4baa-b664-ff946c0f7e29 req-3b8dc3d6-aa2e-4ba4-91e0-71c0d714eb73 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:35.064540 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-fecc3695-51cc-4baa-b664-ff946c0f7e29 req-3b8dc3d6-aa2e-4ba4-91e0-71c0d714eb73 service nova] Creating event network-changed:61286b42-0dd3-4e59-a3e6-3d50dccc2a6d for instance 6304f059-f069-47d9-808f-7546856e6a12 on hv-cinder-85220 Aug 05 20:49:35.069736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-fecc3695-51cc-4baa-b664-ff946c0f7e29 req-3b8dc3d6-aa2e-4ba4-91e0-71c0d714eb73 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036351 Aug 05 20:49:35.070533 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 361/759] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:35.097446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-836e2a1f-659e-444d-b5ea-e54cd2d3b25f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:35.098005 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-836e2a1f-659e-444d-b5ea-e54cd2d3b25f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:35.104496 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-836e2a1f-659e-444d-b5ea-e54cd2d3b25f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:35.104994 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-836e2a1f-659e-444d-b5ea-e54cd2d3b25f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:35.105413 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-836e2a1f-659e-444d-b5ea-e54cd2d3b25f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:35.106340 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-836e2a1f-659e-444d-b5ea-e54cd2d3b25f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:35.106802 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-836e2a1f-659e-444d-b5ea-e54cd2d3b25f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:35.107231 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-836e2a1f-659e-444d-b5ea-e54cd2d3b25f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:35.130521 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-836e2a1f-659e-444d-b5ea-e54cd2d3b25f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lazy-loading 'flavor' on Instance uuid fe498615-6695-4746-89be-48a9e31f6b4d {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:49:35.326548 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-836e2a1f-659e-444d-b5ea-e54cd2d3b25f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "POST /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d/action" status: 202 len: 0 microversion: 2.20 time: 0.232972 Aug 05 20:49:35.327151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 399/760] 10.222.0.100 () {62 vars in 1324 bytes} [Fri Aug 5 20:49:35 2022] POST /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:49:35.336704 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d0bf699f-caf1-4128-bb11-5a3711e3ca1b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:35.337774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d0bf699f-caf1-4128-bb11-5a3711e3ca1b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:35.344469 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d0bf699f-caf1-4128-bb11-5a3711e3ca1b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:35.345226 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d0bf699f-caf1-4128-bb11-5a3711e3ca1b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:35.345657 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d0bf699f-caf1-4128-bb11-5a3711e3ca1b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:35.346393 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d0bf699f-caf1-4128-bb11-5a3711e3ca1b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:35.347054 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d0bf699f-caf1-4128-bb11-5a3711e3ca1b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:35.347513 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d0bf699f-caf1-4128-bb11-5a3711e3ca1b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:35.821067 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d0bf699f-caf1-4128-bb11-5a3711e3ca1b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:35.832447 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d0bf699f-caf1-4128-bb11-5a3711e3ca1b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:35.834312 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d0bf699f-caf1-4128-bb11-5a3711e3ca1b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:35.835515 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d0bf699f-caf1-4128-bb11-5a3711e3ca1b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.503569 Aug 05 20:49:35.836213 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 362/761] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:35 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:36.011246 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-441ae305-1621-4e21-ab49-956fa40a4bf6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:36.012112 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-441ae305-1621-4e21-ab49-956fa40a4bf6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:36.018621 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-441ae305-1621-4e21-ab49-956fa40a4bf6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:36.019378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-441ae305-1621-4e21-ab49-956fa40a4bf6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:36.019948 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-441ae305-1621-4e21-ab49-956fa40a4bf6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:36.020700 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-441ae305-1621-4e21-ab49-956fa40a4bf6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:36.021113 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-441ae305-1621-4e21-ab49-956fa40a4bf6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:36.021571 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-441ae305-1621-4e21-ab49-956fa40a4bf6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:36.316847 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-441ae305-1621-4e21-ab49-956fa40a4bf6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:36.325085 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-441ae305-1621-4e21-ab49-956fa40a4bf6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1370 microversion: 2.1 time: 0.318939 Aug 05 20:49:36.325722 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 400/762] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:36 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1370 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:36.859277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d14981eb-ee0c-404e-8390-2e71ac6d95d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:36.859942 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d14981eb-ee0c-404e-8390-2e71ac6d95d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:36.866802 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d14981eb-ee0c-404e-8390-2e71ac6d95d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:36.867345 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d14981eb-ee0c-404e-8390-2e71ac6d95d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:36.867885 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d14981eb-ee0c-404e-8390-2e71ac6d95d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:36.868541 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d14981eb-ee0c-404e-8390-2e71ac6d95d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:36.869031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d14981eb-ee0c-404e-8390-2e71ac6d95d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:36.869454 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d14981eb-ee0c-404e-8390-2e71ac6d95d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:37.083211 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d14981eb-ee0c-404e-8390-2e71ac6d95d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:37.092737 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d14981eb-ee0c-404e-8390-2e71ac6d95d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:37.094507 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d14981eb-ee0c-404e-8390-2e71ac6d95d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:37.095871 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d14981eb-ee0c-404e-8390-2e71ac6d95d5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.240679 Aug 05 20:49:37.096514 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 363/763] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:36 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:37.350984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-99dbf35a-46f0-4827-bf3a-ca3dccc1cb3c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:37.353261 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-99dbf35a-46f0-4827-bf3a-ca3dccc1cb3c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:37.360840 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-99dbf35a-46f0-4827-bf3a-ca3dccc1cb3c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:37.361904 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-99dbf35a-46f0-4827-bf3a-ca3dccc1cb3c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:37.362509 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-99dbf35a-46f0-4827-bf3a-ca3dccc1cb3c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:37.363899 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-99dbf35a-46f0-4827-bf3a-ca3dccc1cb3c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:37.364530 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-99dbf35a-46f0-4827-bf3a-ca3dccc1cb3c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:37.365550 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-99dbf35a-46f0-4827-bf3a-ca3dccc1cb3c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:37.598218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-99dbf35a-46f0-4827-bf3a-ca3dccc1cb3c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:37.607239 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-99dbf35a-46f0-4827-bf3a-ca3dccc1cb3c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1370 microversion: 2.1 time: 0.264371 Aug 05 20:49:37.610567 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 401/764] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:37 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:37.933702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9edb9640-5c24-48a8-89b7-8a6f00142f66 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:37.934250 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9edb9640-5c24-48a8-89b7-8a6f00142f66 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:37.944637 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9edb9640-5c24-48a8-89b7-8a6f00142f66 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:37.945185 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9edb9640-5c24-48a8-89b7-8a6f00142f66 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:37.945635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9edb9640-5c24-48a8-89b7-8a6f00142f66 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:37.946365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9edb9640-5c24-48a8-89b7-8a6f00142f66 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:37.946825 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9edb9640-5c24-48a8-89b7-8a6f00142f66 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:37.947253 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9edb9640-5c24-48a8-89b7-8a6f00142f66 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:37.984272 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-9edb9640-5c24-48a8-89b7-8a6f00142f66 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lazy-loading 'flavor' on Instance uuid c12ad125-6f29-4ee3-971f-d1c23391c89f {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:49:38.085247 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9edb9640-5c24-48a8-89b7-8a6f00142f66 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "POST /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f/action" status: 202 len: 0 microversion: 2.1 time: 0.155818 Aug 05 20:49:38.089729 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 364/765] 10.222.0.100 () {60 vars in 1283 bytes} [Fri Aug 5 20:49:37 2022] POST /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:49:38.101438 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-62799767-39b2-455b-947b-1b36956edde7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:38.107115 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-62799767-39b2-455b-947b-1b36956edde7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:38.111126 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:38.118608 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62799767-39b2-455b-947b-1b36956edde7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:38.119524 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62799767-39b2-455b-947b-1b36956edde7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:38.120200 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62799767-39b2-455b-947b-1b36956edde7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:38.121659 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62799767-39b2-455b-947b-1b36956edde7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:38.122259 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4feb5984-6299-43c7-9689-613766574dad tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:38.122594 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62799767-39b2-455b-947b-1b36956edde7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:38.123032 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4feb5984-6299-43c7-9689-613766574dad tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:38.123920 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62799767-39b2-455b-947b-1b36956edde7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:38.132915 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4feb5984-6299-43c7-9689-613766574dad tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:38.144819 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4feb5984-6299-43c7-9689-613766574dad tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:38.146062 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:38.146359 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4feb5984-6299-43c7-9689-613766574dad tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:38.147274 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4feb5984-6299-43c7-9689-613766574dad tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:38.148090 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4feb5984-6299-43c7-9689-613766574dad tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:38.149063 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4feb5984-6299-43c7-9689-613766574dad tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:38.175293 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:38.350373 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-62799767-39b2-455b-947b-1b36956edde7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:38.357061 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4feb5984-6299-43c7-9689-613766574dad tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:38.358707 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-62799767-39b2-455b-947b-1b36956edde7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1568 microversion: 2.1 time: 0.267043 Aug 05 20:49:38.365507 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4feb5984-6299-43c7-9689-613766574dad tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:38.367039 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4feb5984-6299-43c7-9689-613766574dad tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:38.368699 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4feb5984-6299-43c7-9689-613766574dad tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.252259 Aug 05 20:49:38.369056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 365/766] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:38 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:38.371747 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 402/767] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:38 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1568 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:38.628652 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-6d65d0b8-6798-4968-b433-89b0de3419bf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:38.629623 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-6d65d0b8-6798-4968-b433-89b0de3419bf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:38.635890 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6d65d0b8-6798-4968-b433-89b0de3419bf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:38.636592 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6d65d0b8-6798-4968-b433-89b0de3419bf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:38.637317 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6d65d0b8-6798-4968-b433-89b0de3419bf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:38.638241 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6d65d0b8-6798-4968-b433-89b0de3419bf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:38.638697 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6d65d0b8-6798-4968-b433-89b0de3419bf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:38.639281 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6d65d0b8-6798-4968-b433-89b0de3419bf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:38.802911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-6d65d0b8-6798-4968-b433-89b0de3419bf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:38.812300 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-6d65d0b8-6798-4968-b433-89b0de3419bf tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1370 microversion: 2.1 time: 0.187419 Aug 05 20:49:38.813911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 366/768] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:38 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:49:39.380722 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5b543546-d170-408b-ad14-ebdca157fbc3 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:39.381504 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5b543546-d170-408b-ad14-ebdca157fbc3 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:39.388495 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b543546-d170-408b-ad14-ebdca157fbc3 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:39.389110 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b543546-d170-408b-ad14-ebdca157fbc3 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:39.389408 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b543546-d170-408b-ad14-ebdca157fbc3 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:39.390110 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b543546-d170-408b-ad14-ebdca157fbc3 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:39.390547 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b543546-d170-408b-ad14-ebdca157fbc3 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:39.390966 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5b543546-d170-408b-ad14-ebdca157fbc3 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:39.392422 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7d75bf78-f096-44f3-8672-039ea20deca4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:39.393746 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-7d75bf78-f096-44f3-8672-039ea20deca4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:39.401337 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7d75bf78-f096-44f3-8672-039ea20deca4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:39.402000 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7d75bf78-f096-44f3-8672-039ea20deca4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:39.403463 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7d75bf78-f096-44f3-8672-039ea20deca4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:39.404340 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7d75bf78-f096-44f3-8672-039ea20deca4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:39.404841 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7d75bf78-f096-44f3-8672-039ea20deca4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:39.405440 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7d75bf78-f096-44f3-8672-039ea20deca4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:39.600242 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5b543546-d170-408b-ad14-ebdca157fbc3 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:39.607386 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7d75bf78-f096-44f3-8672-039ea20deca4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:39.609667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5b543546-d170-408b-ad14-ebdca157fbc3 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1568 microversion: 2.1 time: 0.232800 Aug 05 20:49:39.610360 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 403/769] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:39 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:39.616067 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7d75bf78-f096-44f3-8672-039ea20deca4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:39.617838 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7d75bf78-f096-44f3-8672-039ea20deca4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:39.619026 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-7d75bf78-f096-44f3-8672-039ea20deca4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.230781 Aug 05 20:49:39.619582 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 367/770] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:39 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:39.834442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d609a14a-56f6-4c2c-859d-cf0db7fbbf87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:39.835347 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d609a14a-56f6-4c2c-859d-cf0db7fbbf87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:39.842191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d609a14a-56f6-4c2c-859d-cf0db7fbbf87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:39.842764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d609a14a-56f6-4c2c-859d-cf0db7fbbf87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:39.843465 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d609a14a-56f6-4c2c-859d-cf0db7fbbf87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:39.844232 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d609a14a-56f6-4c2c-859d-cf0db7fbbf87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:39.844768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d609a14a-56f6-4c2c-859d-cf0db7fbbf87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:39.845401 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d609a14a-56f6-4c2c-859d-cf0db7fbbf87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:40.000294 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d609a14a-56f6-4c2c-859d-cf0db7fbbf87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:40.008207 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d609a14a-56f6-4c2c-859d-cf0db7fbbf87 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1370 microversion: 2.1 time: 0.177880 Aug 05 20:49:40.008888 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 404/771] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:39 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:40.631953 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0824d854-b774-4314-b1eb-56d91c3c1753 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:40.632686 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0824d854-b774-4314-b1eb-56d91c3c1753 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:40.639559 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0824d854-b774-4314-b1eb-56d91c3c1753 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:40.640050 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0824d854-b774-4314-b1eb-56d91c3c1753 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:40.640490 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0824d854-b774-4314-b1eb-56d91c3c1753 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:40.641192 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0824d854-b774-4314-b1eb-56d91c3c1753 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:40.641651 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0824d854-b774-4314-b1eb-56d91c3c1753 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:40.641805 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3da04a32-4a37-48fb-adfd-5ba016450341 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:40.642224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0824d854-b774-4314-b1eb-56d91c3c1753 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:40.642317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3da04a32-4a37-48fb-adfd-5ba016450341 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:40.649006 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3da04a32-4a37-48fb-adfd-5ba016450341 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:40.649491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3da04a32-4a37-48fb-adfd-5ba016450341 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:40.649917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3da04a32-4a37-48fb-adfd-5ba016450341 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:40.650591 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3da04a32-4a37-48fb-adfd-5ba016450341 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:40.651035 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3da04a32-4a37-48fb-adfd-5ba016450341 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:40.651482 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3da04a32-4a37-48fb-adfd-5ba016450341 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:40.841735 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0824d854-b774-4314-b1eb-56d91c3c1753 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:40.845015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3da04a32-4a37-48fb-adfd-5ba016450341 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:40.854498 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3da04a32-4a37-48fb-adfd-5ba016450341 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:40.856146 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0824d854-b774-4314-b1eb-56d91c3c1753 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1568 microversion: 2.1 time: 0.228185 Aug 05 20:49:40.856429 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3da04a32-4a37-48fb-adfd-5ba016450341 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:40.856721 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 368/772] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:40 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:40.865926 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3da04a32-4a37-48fb-adfd-5ba016450341 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.220393 Aug 05 20:49:40.865926 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 405/773] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:40 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:41.031713 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-db4c5ca0-db5c-445f-bda3-ae0b37a2f24d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:41.032469 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-db4c5ca0-db5c-445f-bda3-ae0b37a2f24d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:41.042391 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-db4c5ca0-db5c-445f-bda3-ae0b37a2f24d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:41.043170 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-db4c5ca0-db5c-445f-bda3-ae0b37a2f24d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:41.043918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-db4c5ca0-db5c-445f-bda3-ae0b37a2f24d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:41.045035 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-db4c5ca0-db5c-445f-bda3-ae0b37a2f24d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:41.045773 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-db4c5ca0-db5c-445f-bda3-ae0b37a2f24d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:41.046456 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-db4c5ca0-db5c-445f-bda3-ae0b37a2f24d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:41.192082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-db4c5ca0-db5c-445f-bda3-ae0b37a2f24d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:41.200329 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-db4c5ca0-db5c-445f-bda3-ae0b37a2f24d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1370 microversion: 2.1 time: 0.174609 Aug 05 20:49:41.200901 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 406/774] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:41 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:41.878244 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7fd56878-876f-4597-967c-cf8afa56f3d5 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:41.878910 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-7fd56878-876f-4597-967c-cf8afa56f3d5 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:41.880987 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=6 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:41.881993 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1805d20f-ff87-4df4-8033-04df40659708 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:41.883401 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1805d20f-ff87-4df4-8033-04df40659708 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:41.885671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:41.886438 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:41.888090 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7fd56878-876f-4597-967c-cf8afa56f3d5 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:41.888647 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7fd56878-876f-4597-967c-cf8afa56f3d5 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:41.889122 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7fd56878-876f-4597-967c-cf8afa56f3d5 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:41.889923 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7fd56878-876f-4597-967c-cf8afa56f3d5 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:41.890581 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7fd56878-876f-4597-967c-cf8afa56f3d5 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:41.890824 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7fd56878-876f-4597-967c-cf8afa56f3d5 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:41.892887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1805d20f-ff87-4df4-8033-04df40659708 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:41.893317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1805d20f-ff87-4df4-8033-04df40659708 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:41.893896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1805d20f-ff87-4df4-8033-04df40659708 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:41.894712 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1805d20f-ff87-4df4-8033-04df40659708 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:41.895205 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1805d20f-ff87-4df4-8033-04df40659708 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:41.895721 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1805d20f-ff87-4df4-8033-04df40659708 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:42.090676 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7fd56878-876f-4597-967c-cf8afa56f3d5 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:42.094493 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1805d20f-ff87-4df4-8033-04df40659708 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:42.102072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-7fd56878-876f-4597-967c-cf8afa56f3d5 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1568 microversion: 2.1 time: 0.227820 Aug 05 20:49:42.102661 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 369/775] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:41 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:42.105820 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1805d20f-ff87-4df4-8033-04df40659708 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:42.107453 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1805d20f-ff87-4df4-8033-04df40659708 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:42.108629 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1805d20f-ff87-4df4-8033-04df40659708 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.231260 Aug 05 20:49:42.109163 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 407/776] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:41 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:42.221315 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-14757d02-729e-4fc0-b2e3-86d01200d7cb tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:42.221931 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-14757d02-729e-4fc0-b2e3-86d01200d7cb tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:42.228371 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-14757d02-729e-4fc0-b2e3-86d01200d7cb tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:42.228866 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-14757d02-729e-4fc0-b2e3-86d01200d7cb tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:42.229308 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-14757d02-729e-4fc0-b2e3-86d01200d7cb tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:42.230019 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-14757d02-729e-4fc0-b2e3-86d01200d7cb tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:42.234659 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-14757d02-729e-4fc0-b2e3-86d01200d7cb tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:42.235209 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-14757d02-729e-4fc0-b2e3-86d01200d7cb tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:42.354430 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-86c31ac4-f022-48b0-a432-4157cdea0ff3 req-80417008-218e-4a24-bd8b-b9433ae0fdcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6304f059-f069-47d9-808f-7546856e6a12", "name": "network-vif-plugged", "status": "completed", "tag": "61286b42-0dd3-4e59-a3e6-3d50dccc2a6d"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:42.368628 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-86c31ac4-f022-48b0-a432-4157cdea0ff3 req-80417008-218e-4a24-bd8b-b9433ae0fdcd service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:42.369433 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-86c31ac4-f022-48b0-a432-4157cdea0ff3 req-80417008-218e-4a24-bd8b-b9433ae0fdcd service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:42.370169 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-86c31ac4-f022-48b0-a432-4157cdea0ff3 req-80417008-218e-4a24-bd8b-b9433ae0fdcd service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:42.376340 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-14757d02-729e-4fc0-b2e3-86d01200d7cb tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:42.385744 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-14757d02-729e-4fc0-b2e3-86d01200d7cb tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1370 microversion: 2.1 time: 0.168331 Aug 05 20:49:42.386328 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 370/777] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:42 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:42.401245 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-86c31ac4-f022-48b0-a432-4157cdea0ff3 req-80417008-218e-4a24-bd8b-b9433ae0fdcd service nova] Creating event network-vif-plugged:61286b42-0dd3-4e59-a3e6-3d50dccc2a6d for instance 6304f059-f069-47d9-808f-7546856e6a12 on hv-cinder-85220 Aug 05 20:49:42.406722 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-86c31ac4-f022-48b0-a432-4157cdea0ff3 req-80417008-218e-4a24-bd8b-b9433ae0fdcd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057213 Aug 05 20:49:42.407594 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 408/778] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:43.127677 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c0088ef4-c1c9-4303-959f-ce298ef6e233 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:43.128872 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c0088ef4-c1c9-4303-959f-ce298ef6e233 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:43.140113 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c0088ef4-c1c9-4303-959f-ce298ef6e233 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:43.140930 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c0088ef4-c1c9-4303-959f-ce298ef6e233 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:43.141190 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f0996765-df97-404f-adc2-5afe10407156 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:43.141882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c0088ef4-c1c9-4303-959f-ce298ef6e233 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:43.142266 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f0996765-df97-404f-adc2-5afe10407156 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:43.142771 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c0088ef4-c1c9-4303-959f-ce298ef6e233 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:43.143572 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c0088ef4-c1c9-4303-959f-ce298ef6e233 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:43.144280 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c0088ef4-c1c9-4303-959f-ce298ef6e233 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:43.151851 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f0996765-df97-404f-adc2-5afe10407156 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:43.152660 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f0996765-df97-404f-adc2-5afe10407156 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:43.153095 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f0996765-df97-404f-adc2-5afe10407156 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:43.153796 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f0996765-df97-404f-adc2-5afe10407156 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:43.154251 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f0996765-df97-404f-adc2-5afe10407156 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:43.154672 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f0996765-df97-404f-adc2-5afe10407156 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:43.345704 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c0088ef4-c1c9-4303-959f-ce298ef6e233 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:43.349587 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f0996765-df97-404f-adc2-5afe10407156 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:43.354194 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c0088ef4-c1c9-4303-959f-ce298ef6e233 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1568 microversion: 2.1 time: 0.233190 Aug 05 20:49:43.354770 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 371/779] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:43 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:43.359030 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f0996765-df97-404f-adc2-5afe10407156 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:43.360699 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f0996765-df97-404f-adc2-5afe10407156 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:43.361873 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f0996765-df97-404f-adc2-5afe10407156 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.228051 Aug 05 20:49:43.362410 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 409/780] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:43 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:43.407964 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ed44bd08-481d-4a20-9b70-dfc4b69d4825 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:43.408575 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ed44bd08-481d-4a20-9b70-dfc4b69d4825 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:43.416190 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ed44bd08-481d-4a20-9b70-dfc4b69d4825 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:43.416668 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ed44bd08-481d-4a20-9b70-dfc4b69d4825 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:43.417227 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ed44bd08-481d-4a20-9b70-dfc4b69d4825 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:43.417918 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ed44bd08-481d-4a20-9b70-dfc4b69d4825 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:43.418395 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ed44bd08-481d-4a20-9b70-dfc4b69d4825 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:43.418839 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ed44bd08-481d-4a20-9b70-dfc4b69d4825 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:43.560576 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ed44bd08-481d-4a20-9b70-dfc4b69d4825 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:43.568552 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ed44bd08-481d-4a20-9b70-dfc4b69d4825 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1370 microversion: 2.1 time: 0.164428 Aug 05 20:49:43.569124 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 372/781] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:43 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:44.376033 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ace80cb6-0e9d-4199-83d8-073c161a9228 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:44.376944 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ace80cb6-0e9d-4199-83d8-073c161a9228 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:44.384907 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ace80cb6-0e9d-4199-83d8-073c161a9228 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:44.385396 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ace80cb6-0e9d-4199-83d8-073c161a9228 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:44.385834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ace80cb6-0e9d-4199-83d8-073c161a9228 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:44.386503 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d3830c27-85b6-418b-a066-54ed970c58e5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:44.386974 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ace80cb6-0e9d-4199-83d8-073c161a9228 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:44.386974 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ace80cb6-0e9d-4199-83d8-073c161a9228 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:44.387352 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d3830c27-85b6-418b-a066-54ed970c58e5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:44.387490 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ace80cb6-0e9d-4199-83d8-073c161a9228 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:44.394378 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d3830c27-85b6-418b-a066-54ed970c58e5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:44.394988 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d3830c27-85b6-418b-a066-54ed970c58e5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:44.395572 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d3830c27-85b6-418b-a066-54ed970c58e5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:44.396346 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d3830c27-85b6-418b-a066-54ed970c58e5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:44.397011 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d3830c27-85b6-418b-a066-54ed970c58e5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:44.397545 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d3830c27-85b6-418b-a066-54ed970c58e5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:44.587504 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d3830c27-85b6-418b-a066-54ed970c58e5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:44.592301 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ace80cb6-0e9d-4199-83d8-073c161a9228 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:44.598729 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d3830c27-85b6-418b-a066-54ed970c58e5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:44.600309 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d3830c27-85b6-418b-a066-54ed970c58e5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:44.601353 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ace80cb6-0e9d-4199-83d8-073c161a9228 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1568 microversion: 2.1 time: 0.229400 Aug 05 20:49:44.601487 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d3830c27-85b6-418b-a066-54ed970c58e5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.219976 Aug 05 20:49:44.602038 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 373/782] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:44 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:44.602998 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 410/783] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:44 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:44.606467 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-72e75568-003f-477a-8d10-405e1b79f850 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:44.607333 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-72e75568-003f-477a-8d10-405e1b79f850 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:44.613584 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-72e75568-003f-477a-8d10-405e1b79f850 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:44.614086 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-72e75568-003f-477a-8d10-405e1b79f850 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:44.614526 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-72e75568-003f-477a-8d10-405e1b79f850 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:44.615222 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-72e75568-003f-477a-8d10-405e1b79f850 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:44.615725 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-72e75568-003f-477a-8d10-405e1b79f850 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:44.616154 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-72e75568-003f-477a-8d10-405e1b79f850 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:44.747246 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-72e75568-003f-477a-8d10-405e1b79f850 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:44.755448 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-72e75568-003f-477a-8d10-405e1b79f850 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1559 microversion: 2.1 time: 0.152383 Aug 05 20:49:44.756059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 374/784] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:44 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:44.776226 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4413fd81-6894-40d3-98f2-bf63dd75091c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:44.776836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4413fd81-6894-40d3-98f2-bf63dd75091c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:44.783172 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4413fd81-6894-40d3-98f2-bf63dd75091c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:44.783681 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4413fd81-6894-40d3-98f2-bf63dd75091c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:44.784108 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4413fd81-6894-40d3-98f2-bf63dd75091c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:44.784806 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4413fd81-6894-40d3-98f2-bf63dd75091c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:44.785259 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4413fd81-6894-40d3-98f2-bf63dd75091c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:44.785684 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4413fd81-6894-40d3-98f2-bf63dd75091c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:44.863149 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4413fd81-6894-40d3-98f2-bf63dd75091c tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091222 Aug 05 20:49:44.863805 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 411/785] 10.222.0.100 () {58 vars in 1280 bytes} [Fri Aug 5 20:49:44 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:45.622883 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-5ab8145e-80e1-418d-a4c6-fcbc5aa4a97e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:45.623487 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-5ab8145e-80e1-418d-a4c6-fcbc5aa4a97e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:45.625064 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-66bd841b-f01e-481f-83f7-efa9c3f3747e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:45.625675 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-66bd841b-f01e-481f-83f7-efa9c3f3747e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:45.633048 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ab8145e-80e1-418d-a4c6-fcbc5aa4a97e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:45.633048 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ab8145e-80e1-418d-a4c6-fcbc5aa4a97e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:45.633048 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ab8145e-80e1-418d-a4c6-fcbc5aa4a97e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:45.633531 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ab8145e-80e1-418d-a4c6-fcbc5aa4a97e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:45.634592 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ab8145e-80e1-418d-a4c6-fcbc5aa4a97e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:45.635003 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-66bd841b-f01e-481f-83f7-efa9c3f3747e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:45.635141 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ab8145e-80e1-418d-a4c6-fcbc5aa4a97e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:45.635808 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-66bd841b-f01e-481f-83f7-efa9c3f3747e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:45.636244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-66bd841b-f01e-481f-83f7-efa9c3f3747e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:45.637021 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-66bd841b-f01e-481f-83f7-efa9c3f3747e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:45.637467 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-66bd841b-f01e-481f-83f7-efa9c3f3747e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:45.638044 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-66bd841b-f01e-481f-83f7-efa9c3f3747e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:45.840092 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-5ab8145e-80e1-418d-a4c6-fcbc5aa4a97e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:45.844802 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-66bd841b-f01e-481f-83f7-efa9c3f3747e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:45.849841 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-5ab8145e-80e1-418d-a4c6-fcbc5aa4a97e tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1568 microversion: 2.1 time: 0.230573 Aug 05 20:49:45.850528 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 375/786] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:45 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:45.857814 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-66bd841b-f01e-481f-83f7-efa9c3f3747e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:45.860449 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-66bd841b-f01e-481f-83f7-efa9c3f3747e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:45.862210 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-66bd841b-f01e-481f-83f7-efa9c3f3747e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.241600 Aug 05 20:49:45.863025 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 412/787] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:45 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:46.283337 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-5c0e9ef2-d5dd-47cf-9e93-a2f0acdc0d2a req-75843897-776d-41a3-b53e-eea3ae0b1b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6304f059-f069-47d9-808f-7546856e6a12", "tag": "61286b42-0dd3-4e59-a3e6-3d50dccc2a6d"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:46.292883 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-5c0e9ef2-d5dd-47cf-9e93-a2f0acdc0d2a req-75843897-776d-41a3-b53e-eea3ae0b1b21 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:46.293354 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-5c0e9ef2-d5dd-47cf-9e93-a2f0acdc0d2a req-75843897-776d-41a3-b53e-eea3ae0b1b21 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:46.293776 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-5c0e9ef2-d5dd-47cf-9e93-a2f0acdc0d2a req-75843897-776d-41a3-b53e-eea3ae0b1b21 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:46.305024 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-5c0e9ef2-d5dd-47cf-9e93-a2f0acdc0d2a req-75843897-776d-41a3-b53e-eea3ae0b1b21 service nova] Creating event network-changed:61286b42-0dd3-4e59-a3e6-3d50dccc2a6d for instance 6304f059-f069-47d9-808f-7546856e6a12 on hv-cinder-85220 Aug 05 20:49:46.310369 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-5c0e9ef2-d5dd-47cf-9e93-a2f0acdc0d2a req-75843897-776d-41a3-b53e-eea3ae0b1b21 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220352 Aug 05 20:49:46.310966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 376/788] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:46.871902 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ea3aa874-6383-4c57-8a14-93ff3ecebc15 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:46.872508 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ea3aa874-6383-4c57-8a14-93ff3ecebc15 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:46.879217 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ea3aa874-6383-4c57-8a14-93ff3ecebc15 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:46.879710 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ea3aa874-6383-4c57-8a14-93ff3ecebc15 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:46.880406 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ea3aa874-6383-4c57-8a14-93ff3ecebc15 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:46.881220 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ea3aa874-6383-4c57-8a14-93ff3ecebc15 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:46.881665 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ea3aa874-6383-4c57-8a14-93ff3ecebc15 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:46.882092 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ea3aa874-6383-4c57-8a14-93ff3ecebc15 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:46.887778 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-fa35aa08-e45c-4772-9390-45d0c007fe85 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:46.890397 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-fa35aa08-e45c-4772-9390-45d0c007fe85 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:46.903074 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fa35aa08-e45c-4772-9390-45d0c007fe85 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:46.903582 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fa35aa08-e45c-4772-9390-45d0c007fe85 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:46.904034 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fa35aa08-e45c-4772-9390-45d0c007fe85 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:46.904751 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fa35aa08-e45c-4772-9390-45d0c007fe85 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:46.905209 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fa35aa08-e45c-4772-9390-45d0c007fe85 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:46.905660 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fa35aa08-e45c-4772-9390-45d0c007fe85 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:47.389938 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ea3aa874-6383-4c57-8a14-93ff3ecebc15 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:47.396894 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-fa35aa08-e45c-4772-9390-45d0c007fe85 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:47.399998 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ea3aa874-6383-4c57-8a14-93ff3ecebc15 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1568 microversion: 2.1 time: 0.531937 Aug 05 20:49:47.400634 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 413/789] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:46 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1568 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:47.406286 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-fa35aa08-e45c-4772-9390-45d0c007fe85 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:47.407837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-fa35aa08-e45c-4772-9390-45d0c007fe85 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:47.409025 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-fa35aa08-e45c-4772-9390-45d0c007fe85 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.526430 Aug 05 20:49:47.409586 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 377/790] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:46 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:49:48.423083 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-068fd97a-811d-4727-8f4d-87ac2cb52858 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:48.423726 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-068fd97a-811d-4727-8f4d-87ac2cb52858 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:48.432345 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-068fd97a-811d-4727-8f4d-87ac2cb52858 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:48.433072 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-068fd97a-811d-4727-8f4d-87ac2cb52858 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:48.433344 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-fb155e44-ff6a-45a0-917b-0e1d72207949 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:48.433810 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-068fd97a-811d-4727-8f4d-87ac2cb52858 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:48.434526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-068fd97a-811d-4727-8f4d-87ac2cb52858 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:48.434779 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-fb155e44-ff6a-45a0-917b-0e1d72207949 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:48.434970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-068fd97a-811d-4727-8f4d-87ac2cb52858 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:48.435416 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-068fd97a-811d-4727-8f4d-87ac2cb52858 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:48.441986 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fb155e44-ff6a-45a0-917b-0e1d72207949 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:48.442578 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fb155e44-ff6a-45a0-917b-0e1d72207949 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:48.443052 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fb155e44-ff6a-45a0-917b-0e1d72207949 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:48.444036 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fb155e44-ff6a-45a0-917b-0e1d72207949 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:48.444539 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fb155e44-ff6a-45a0-917b-0e1d72207949 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:48.445034 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fb155e44-ff6a-45a0-917b-0e1d72207949 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:48.735654 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-fb155e44-ff6a-45a0-917b-0e1d72207949 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:48.744500 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-fb155e44-ff6a-45a0-917b-0e1d72207949 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:48.746046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-fb155e44-ff6a-45a0-917b-0e1d72207949 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:48.747271 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-fb155e44-ff6a-45a0-917b-0e1d72207949 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.318002 Aug 05 20:49:48.747867 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 378/791] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:48 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:48.756949 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-068fd97a-811d-4727-8f4d-87ac2cb52858 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:48.764942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-068fd97a-811d-4727-8f4d-87ac2cb52858 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1568 microversion: 2.1 time: 0.346278 Aug 05 20:49:48.765610 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 414/792] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:48 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1568 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:49.770843 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-cfbc5f44-9c2b-4aaf-9204-43eaf0106909 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:49.771480 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-cfbc5f44-9c2b-4aaf-9204-43eaf0106909 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:49.779335 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cfbc5f44-9c2b-4aaf-9204-43eaf0106909 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:49.779870 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cfbc5f44-9c2b-4aaf-9204-43eaf0106909 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:49.780301 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cfbc5f44-9c2b-4aaf-9204-43eaf0106909 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:49.780996 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cfbc5f44-9c2b-4aaf-9204-43eaf0106909 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:49.781442 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cfbc5f44-9c2b-4aaf-9204-43eaf0106909 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:49.781866 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cfbc5f44-9c2b-4aaf-9204-43eaf0106909 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:49.787386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5d0d2d13-c4fb-409c-a713-e6f78d9428d1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:49.788188 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5d0d2d13-c4fb-409c-a713-e6f78d9428d1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:49.795271 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d0d2d13-c4fb-409c-a713-e6f78d9428d1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:49.795813 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d0d2d13-c4fb-409c-a713-e6f78d9428d1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:49.796254 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d0d2d13-c4fb-409c-a713-e6f78d9428d1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:49.796961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d0d2d13-c4fb-409c-a713-e6f78d9428d1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:49.797428 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d0d2d13-c4fb-409c-a713-e6f78d9428d1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:49.797855 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d0d2d13-c4fb-409c-a713-e6f78d9428d1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:49.978788 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-cfbc5f44-9c2b-4aaf-9204-43eaf0106909 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:49.987294 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-cfbc5f44-9c2b-4aaf-9204-43eaf0106909 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:49.988813 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-cfbc5f44-9c2b-4aaf-9204-43eaf0106909 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:49.990025 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-cfbc5f44-9c2b-4aaf-9204-43eaf0106909 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.223467 Aug 05 20:49:49.990567 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 379/793] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:49 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:49.991768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5d0d2d13-c4fb-409c-a713-e6f78d9428d1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:50.000052 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5d0d2d13-c4fb-409c-a713-e6f78d9428d1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1568 microversion: 2.1 time: 0.216560 Aug 05 20:49:50.000618 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 415/794] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:49 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:51.014621 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-179a270b-8002-4ecc-ac22-ab11d7524c01 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:51.015154 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-179a270b-8002-4ecc-ac22-ab11d7524c01 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:51.021603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6d29ce82-73db-4f66-a4be-fe17ae739ebc tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:51.022180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-179a270b-8002-4ecc-ac22-ab11d7524c01 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:51.022491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6d29ce82-73db-4f66-a4be-fe17ae739ebc tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:51.022617 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-179a270b-8002-4ecc-ac22-ab11d7524c01 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:51.023210 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-179a270b-8002-4ecc-ac22-ab11d7524c01 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:51.023949 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-179a270b-8002-4ecc-ac22-ab11d7524c01 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:51.024523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-179a270b-8002-4ecc-ac22-ab11d7524c01 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:51.025165 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-179a270b-8002-4ecc-ac22-ab11d7524c01 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:51.030552 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d29ce82-73db-4f66-a4be-fe17ae739ebc tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:51.031102 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d29ce82-73db-4f66-a4be-fe17ae739ebc tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:51.031938 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d29ce82-73db-4f66-a4be-fe17ae739ebc tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:51.032841 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d29ce82-73db-4f66-a4be-fe17ae739ebc tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:51.033284 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d29ce82-73db-4f66-a4be-fe17ae739ebc tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:51.033921 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6d29ce82-73db-4f66-a4be-fe17ae739ebc tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:51.245675 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-179a270b-8002-4ecc-ac22-ab11d7524c01 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:51.250474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6d29ce82-73db-4f66-a4be-fe17ae739ebc tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:51.256251 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-179a270b-8002-4ecc-ac22-ab11d7524c01 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:51.258170 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-179a270b-8002-4ecc-ac22-ab11d7524c01 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:51.259016 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6d29ce82-73db-4f66-a4be-fe17ae739ebc tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1568 microversion: 2.1 time: 0.241332 Aug 05 20:49:51.259372 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-179a270b-8002-4ecc-ac22-ab11d7524c01 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1748 microversion: 2.20 time: 0.248903 Aug 05 20:49:51.259624 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 416/795] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:51 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:51.259937 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 380/796] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:51 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1748 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:52.284360 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c058a67e-a472-4e65-9b64-4c8572d2cadf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:52.285268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c058a67e-a472-4e65-9b64-4c8572d2cadf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:52.285766 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-506d6dff-3a3c-4d7c-90ec-98173ab0028d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:52.286689 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-506d6dff-3a3c-4d7c-90ec-98173ab0028d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:52.296736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-506d6dff-3a3c-4d7c-90ec-98173ab0028d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:52.296957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c058a67e-a472-4e65-9b64-4c8572d2cadf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:52.297478 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-506d6dff-3a3c-4d7c-90ec-98173ab0028d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:52.297654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c058a67e-a472-4e65-9b64-4c8572d2cadf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:52.298129 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-506d6dff-3a3c-4d7c-90ec-98173ab0028d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:52.298304 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c058a67e-a472-4e65-9b64-4c8572d2cadf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:52.299171 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-506d6dff-3a3c-4d7c-90ec-98173ab0028d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:52.299393 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c058a67e-a472-4e65-9b64-4c8572d2cadf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:52.299907 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-506d6dff-3a3c-4d7c-90ec-98173ab0028d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:52.300079 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c058a67e-a472-4e65-9b64-4c8572d2cadf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:52.300540 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-506d6dff-3a3c-4d7c-90ec-98173ab0028d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:52.300802 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c058a67e-a472-4e65-9b64-4c8572d2cadf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:52.506472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c058a67e-a472-4e65-9b64-4c8572d2cadf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:52.509368 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-506d6dff-3a3c-4d7c-90ec-98173ab0028d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:52.514501 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c058a67e-a472-4e65-9b64-4c8572d2cadf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1509 microversion: 2.1 time: 0.236190 Aug 05 20:49:52.515093 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 417/797] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:52 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:52.517594 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-506d6dff-3a3c-4d7c-90ec-98173ab0028d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:52.519109 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-506d6dff-3a3c-4d7c-90ec-98173ab0028d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:52.520304 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-506d6dff-3a3c-4d7c-90ec-98173ab0028d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1748 microversion: 2.20 time: 0.240545 Aug 05 20:49:52.520856 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 381/798] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:52 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1748 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:52.534889 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-484095cc-132f-45c8-bac4-2025053300c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:52.535514 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-484095cc-132f-45c8-bac4-2025053300c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:52.541811 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-484095cc-132f-45c8-bac4-2025053300c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:52.542303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-484095cc-132f-45c8-bac4-2025053300c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:52.542752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-484095cc-132f-45c8-bac4-2025053300c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:52.543474 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-484095cc-132f-45c8-bac4-2025053300c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:52.543936 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-484095cc-132f-45c8-bac4-2025053300c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:52.544361 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-484095cc-132f-45c8-bac4-2025053300c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:52.588028 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-484095cc-132f-45c8-bac4-2025053300c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124432) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 20:49:52.662940 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-484095cc-132f-45c8-bac4-2025053300c9 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "POST /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f/action" status: 202 len: 0 microversion: 2.1 time: 0.131723 Aug 05 20:49:52.663493 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 418/799] 10.222.0.100 () {60 vars in 1283 bytes} [Fri Aug 5 20:49:52 2022] POST /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:49:52.672180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-91a0b6d0-fe20-4a10-930e-d044f9d06c2b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:52.672798 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-91a0b6d0-fe20-4a10-930e-d044f9d06c2b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:52.678839 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91a0b6d0-fe20-4a10-930e-d044f9d06c2b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:52.679412 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91a0b6d0-fe20-4a10-930e-d044f9d06c2b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:52.679981 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91a0b6d0-fe20-4a10-930e-d044f9d06c2b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:52.680671 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91a0b6d0-fe20-4a10-930e-d044f9d06c2b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:52.681099 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91a0b6d0-fe20-4a10-930e-d044f9d06c2b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:52.681530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91a0b6d0-fe20-4a10-930e-d044f9d06c2b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:52.697997 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=100 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:52.819090 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-91a0b6d0-fe20-4a10-930e-d044f9d06c2b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:52.827087 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-91a0b6d0-fe20-4a10-930e-d044f9d06c2b tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1517 microversion: 2.1 time: 0.159117 Aug 05 20:49:52.827705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 382/800] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:52 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:53.544354 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a4a8d127-8e3c-44d1-821d-5e6f4cfe28a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:53.545064 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a4a8d127-8e3c-44d1-821d-5e6f4cfe28a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:53.552022 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a4a8d127-8e3c-44d1-821d-5e6f4cfe28a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:53.552518 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a4a8d127-8e3c-44d1-821d-5e6f4cfe28a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:53.552968 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a4a8d127-8e3c-44d1-821d-5e6f4cfe28a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:53.553663 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a4a8d127-8e3c-44d1-821d-5e6f4cfe28a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:53.554106 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a4a8d127-8e3c-44d1-821d-5e6f4cfe28a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:53.554579 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a4a8d127-8e3c-44d1-821d-5e6f4cfe28a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:53.558741 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:49:53.702562 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a4a8d127-8e3c-44d1-821d-5e6f4cfe28a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:53.710944 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a4a8d127-8e3c-44d1-821d-5e6f4cfe28a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:53.712504 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a4a8d127-8e3c-44d1-821d-5e6f4cfe28a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:53.713668 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a4a8d127-8e3c-44d1-821d-5e6f4cfe28a5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1748 microversion: 2.20 time: 0.173912 Aug 05 20:49:53.714265 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 419/801] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:53 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1748 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:53.849941 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8a351ebb-e445-4398-84eb-c7400fbbb13c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:53.850501 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8a351ebb-e445-4398-84eb-c7400fbbb13c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:53.859659 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8a351ebb-e445-4398-84eb-c7400fbbb13c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:53.860198 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8a351ebb-e445-4398-84eb-c7400fbbb13c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:53.860830 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8a351ebb-e445-4398-84eb-c7400fbbb13c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:53.861786 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8a351ebb-e445-4398-84eb-c7400fbbb13c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:53.862406 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8a351ebb-e445-4398-84eb-c7400fbbb13c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:53.863038 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8a351ebb-e445-4398-84eb-c7400fbbb13c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:54.005811 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8a351ebb-e445-4398-84eb-c7400fbbb13c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:54.013967 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8a351ebb-e445-4398-84eb-c7400fbbb13c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1519 microversion: 2.1 time: 0.169599 Aug 05 20:49:54.014805 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 383/802] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:53 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:49:54.742769 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-cbae85db-2b42-4e37-a5b2-0bfd0359f89e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:54.744783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-cbae85db-2b42-4e37-a5b2-0bfd0359f89e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:54.756232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cbae85db-2b42-4e37-a5b2-0bfd0359f89e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:54.758190 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cbae85db-2b42-4e37-a5b2-0bfd0359f89e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:54.758856 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cbae85db-2b42-4e37-a5b2-0bfd0359f89e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:54.761196 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cbae85db-2b42-4e37-a5b2-0bfd0359f89e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:54.761903 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cbae85db-2b42-4e37-a5b2-0bfd0359f89e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:54.762603 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cbae85db-2b42-4e37-a5b2-0bfd0359f89e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:54.801528 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-8dea4425-4262-4f4f-b08b-4673c6dd448e req-1a8eda95-b6fd-4bc9-ae86-6902a09d28f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12ad125-6f29-4ee3-971f-d1c23391c89f", "name": "network-vif-unplugged", "status": "completed", "tag": "aca05bcd-9297-4365-a6e9-dca538228f87"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:54.837866 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-8dea4425-4262-4f4f-b08b-4673c6dd448e req-1a8eda95-b6fd-4bc9-ae86-6902a09d28f8 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:54.843264 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-8dea4425-4262-4f4f-b08b-4673c6dd448e req-1a8eda95-b6fd-4bc9-ae86-6902a09d28f8 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:54.843999 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-8dea4425-4262-4f4f-b08b-4673c6dd448e req-1a8eda95-b6fd-4bc9-ae86-6902a09d28f8 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:54.864303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-8dea4425-4262-4f4f-b08b-4673c6dd448e req-1a8eda95-b6fd-4bc9-ae86-6902a09d28f8 service nova] Creating event network-vif-unplugged:aca05bcd-9297-4365-a6e9-dca538228f87 for instance c12ad125-6f29-4ee3-971f-d1c23391c89f on hv-cinder-85220 Aug 05 20:49:54.885156 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-8dea4425-4262-4f4f-b08b-4673c6dd448e req-1a8eda95-b6fd-4bc9-ae86-6902a09d28f8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.265960 Aug 05 20:49:54.886333 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 420/803] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:55.040169 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-540b4de9-d601-4aa2-957f-19984adc3c95 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:55.041398 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-540b4de9-d601-4aa2-957f-19984adc3c95 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:55.049429 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-540b4de9-d601-4aa2-957f-19984adc3c95 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:55.050179 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-540b4de9-d601-4aa2-957f-19984adc3c95 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:55.050757 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-540b4de9-d601-4aa2-957f-19984adc3c95 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:55.051734 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-540b4de9-d601-4aa2-957f-19984adc3c95 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:55.052910 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-540b4de9-d601-4aa2-957f-19984adc3c95 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:55.053497 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-540b4de9-d601-4aa2-957f-19984adc3c95 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:55.117184 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-cbae85db-2b42-4e37-a5b2-0bfd0359f89e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:55.128608 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-cbae85db-2b42-4e37-a5b2-0bfd0359f89e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:55.130173 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-cbae85db-2b42-4e37-a5b2-0bfd0359f89e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:55.131431 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-cbae85db-2b42-4e37-a5b2-0bfd0359f89e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1743 microversion: 2.20 time: 0.397031 Aug 05 20:49:55.133397 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 384/804] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:54 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1743 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:55.369201 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-540b4de9-d601-4aa2-957f-19984adc3c95 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:55.378349 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-540b4de9-d601-4aa2-957f-19984adc3c95 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1575 microversion: 2.1 time: 0.344963 Aug 05 20:49:55.379243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 421/805] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:55 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1575 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:49:56.157538 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0fea63a0-d374-40ba-9619-f98c4eb57d7a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:56.158382 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0fea63a0-d374-40ba-9619-f98c4eb57d7a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:56.165366 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0fea63a0-d374-40ba-9619-f98c4eb57d7a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:56.166144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0fea63a0-d374-40ba-9619-f98c4eb57d7a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:56.166661 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0fea63a0-d374-40ba-9619-f98c4eb57d7a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:56.167468 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0fea63a0-d374-40ba-9619-f98c4eb57d7a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:56.167987 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0fea63a0-d374-40ba-9619-f98c4eb57d7a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:56.168618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0fea63a0-d374-40ba-9619-f98c4eb57d7a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:56.335097 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0fea63a0-d374-40ba-9619-f98c4eb57d7a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:56.345345 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0fea63a0-d374-40ba-9619-f98c4eb57d7a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:56.347636 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0fea63a0-d374-40ba-9619-f98c4eb57d7a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:56.349348 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0fea63a0-d374-40ba-9619-f98c4eb57d7a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1743 microversion: 2.20 time: 0.195818 Aug 05 20:49:56.354066 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 385/806] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:56 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:56.400778 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-31ff8797-c899-464f-aca0-5ae24e231b5a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:56.401562 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-31ff8797-c899-464f-aca0-5ae24e231b5a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:56.409876 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-31ff8797-c899-464f-aca0-5ae24e231b5a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:56.410841 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-31ff8797-c899-464f-aca0-5ae24e231b5a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:56.411619 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-31ff8797-c899-464f-aca0-5ae24e231b5a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:56.412617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-31ff8797-c899-464f-aca0-5ae24e231b5a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:56.413229 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-31ff8797-c899-464f-aca0-5ae24e231b5a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:56.414031 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-31ff8797-c899-464f-aca0-5ae24e231b5a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:56.577084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-31ff8797-c899-464f-aca0-5ae24e231b5a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:56.587458 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-31ff8797-c899-464f-aca0-5ae24e231b5a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1575 microversion: 2.1 time: 0.191258 Aug 05 20:49:56.588624 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 422/807] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:56 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:56.902153 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-885ceed3-b50a-42de-a526-72a4417b5d2d req-ea7f0441-7240-4e4d-be93-7a98d327bc53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe498615-6695-4746-89be-48a9e31f6b4d", "name": "network-vif-plugged", "status": "completed", "tag": "5596f6df-3385-436f-9183-b31838466a7c"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:49:56.912394 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-885ceed3-b50a-42de-a526-72a4417b5d2d req-ea7f0441-7240-4e4d-be93-7a98d327bc53 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:56.913189 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-885ceed3-b50a-42de-a526-72a4417b5d2d req-ea7f0441-7240-4e4d-be93-7a98d327bc53 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:56.913626 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-885ceed3-b50a-42de-a526-72a4417b5d2d req-ea7f0441-7240-4e4d-be93-7a98d327bc53 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:56.927743 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-885ceed3-b50a-42de-a526-72a4417b5d2d req-ea7f0441-7240-4e4d-be93-7a98d327bc53 service nova] Creating event network-vif-plugged:5596f6df-3385-436f-9183-b31838466a7c for instance fe498615-6695-4746-89be-48a9e31f6b4d on hv-cinder-85220 Aug 05 20:49:56.933925 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-885ceed3-b50a-42de-a526-72a4417b5d2d req-ea7f0441-7240-4e4d-be93-7a98d327bc53 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035866 Aug 05 20:49:56.934549 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 386/808] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:49:57.376544 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1ab2e551-d9af-41a9-a6ea-f1f7d374ee8b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:57.377167 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1ab2e551-d9af-41a9-a6ea-f1f7d374ee8b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:57.384098 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1ab2e551-d9af-41a9-a6ea-f1f7d374ee8b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:57.384596 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1ab2e551-d9af-41a9-a6ea-f1f7d374ee8b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:57.385039 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1ab2e551-d9af-41a9-a6ea-f1f7d374ee8b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:57.385756 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1ab2e551-d9af-41a9-a6ea-f1f7d374ee8b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:57.386205 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1ab2e551-d9af-41a9-a6ea-f1f7d374ee8b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:57.386635 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1ab2e551-d9af-41a9-a6ea-f1f7d374ee8b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:57.541296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1ab2e551-d9af-41a9-a6ea-f1f7d374ee8b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:57.549886 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1ab2e551-d9af-41a9-a6ea-f1f7d374ee8b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:57.551921 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1ab2e551-d9af-41a9-a6ea-f1f7d374ee8b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:57.553386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1ab2e551-d9af-41a9-a6ea-f1f7d374ee8b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1743 microversion: 2.20 time: 0.180945 Aug 05 20:49:57.554031 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 423/809] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:57 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:57.610985 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d4402fb2-7449-41ee-bc3d-fa4ed04a0033 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:57.611737 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d4402fb2-7449-41ee-bc3d-fa4ed04a0033 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:57.622522 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d4402fb2-7449-41ee-bc3d-fa4ed04a0033 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:57.623008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d4402fb2-7449-41ee-bc3d-fa4ed04a0033 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:57.623467 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d4402fb2-7449-41ee-bc3d-fa4ed04a0033 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:57.624175 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d4402fb2-7449-41ee-bc3d-fa4ed04a0033 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:57.624629 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d4402fb2-7449-41ee-bc3d-fa4ed04a0033 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:57.625051 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d4402fb2-7449-41ee-bc3d-fa4ed04a0033 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:57.783501 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d4402fb2-7449-41ee-bc3d-fa4ed04a0033 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:57.794682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d4402fb2-7449-41ee-bc3d-fa4ed04a0033 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1575 microversion: 2.1 time: 0.187963 Aug 05 20:49:57.795569 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 387/810] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:57 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:58.576583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-299ffae5-7fad-467b-b525-14c1e3978b63 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:58.577302 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-299ffae5-7fad-467b-b525-14c1e3978b63 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:58.584471 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-299ffae5-7fad-467b-b525-14c1e3978b63 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:58.585272 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-299ffae5-7fad-467b-b525-14c1e3978b63 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:58.585987 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-299ffae5-7fad-467b-b525-14c1e3978b63 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:58.587163 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-299ffae5-7fad-467b-b525-14c1e3978b63 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:58.587788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-299ffae5-7fad-467b-b525-14c1e3978b63 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:58.588211 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-299ffae5-7fad-467b-b525-14c1e3978b63 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:58.738924 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-299ffae5-7fad-467b-b525-14c1e3978b63 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:58.751247 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-299ffae5-7fad-467b-b525-14c1e3978b63 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:58.752814 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-299ffae5-7fad-467b-b525-14c1e3978b63 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:58.753991 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-299ffae5-7fad-467b-b525-14c1e3978b63 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1743 microversion: 2.20 time: 0.181373 Aug 05 20:49:58.754687 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 424/811] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:58 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1743 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:49:58.818072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-b7f4f8af-3265-4185-abc6-519e05512940 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:58.819474 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-b7f4f8af-3265-4185-abc6-519e05512940 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:58.827285 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b7f4f8af-3265-4185-abc6-519e05512940 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:58.827703 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b7f4f8af-3265-4185-abc6-519e05512940 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:58.828140 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b7f4f8af-3265-4185-abc6-519e05512940 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:58.828806 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b7f4f8af-3265-4185-abc6-519e05512940 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:58.829264 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b7f4f8af-3265-4185-abc6-519e05512940 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:58.829673 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b7f4f8af-3265-4185-abc6-519e05512940 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:58.976768 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-b7f4f8af-3265-4185-abc6-519e05512940 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:58.985559 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-b7f4f8af-3265-4185-abc6-519e05512940 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1575 microversion: 2.1 time: 0.171309 Aug 05 20:49:58.986609 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 388/812] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:49:58 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:49:59.780670 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7faa897f-cd99-4072-80f7-ec29471a6715 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:49:59.781299 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7faa897f-cd99-4072-80f7-ec29471a6715 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:49:59.788854 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7faa897f-cd99-4072-80f7-ec29471a6715 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:59.789352 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7faa897f-cd99-4072-80f7-ec29471a6715 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:59.789780 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7faa897f-cd99-4072-80f7-ec29471a6715 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:59.790541 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7faa897f-cd99-4072-80f7-ec29471a6715 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:49:59.790992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7faa897f-cd99-4072-80f7-ec29471a6715 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:49:59.791432 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7faa897f-cd99-4072-80f7-ec29471a6715 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:49:59.933074 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7faa897f-cd99-4072-80f7-ec29471a6715 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:59.943264 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7faa897f-cd99-4072-80f7-ec29471a6715 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:59.945194 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7faa897f-cd99-4072-80f7-ec29471a6715 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:49:59.948010 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7faa897f-cd99-4072-80f7-ec29471a6715 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1743 microversion: 2.20 time: 0.170068 Aug 05 20:49:59.948010 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 425/813] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:49:59 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:00.008019 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-fd2ff53f-f0d0-4925-8362-3bc6634316c1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:00.008614 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-fd2ff53f-f0d0-4925-8362-3bc6634316c1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:00.015571 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fd2ff53f-f0d0-4925-8362-3bc6634316c1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:00.016541 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fd2ff53f-f0d0-4925-8362-3bc6634316c1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:00.016541 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fd2ff53f-f0d0-4925-8362-3bc6634316c1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:00.017169 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fd2ff53f-f0d0-4925-8362-3bc6634316c1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:00.017605 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fd2ff53f-f0d0-4925-8362-3bc6634316c1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:00.018022 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fd2ff53f-f0d0-4925-8362-3bc6634316c1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:00.181369 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-fd2ff53f-f0d0-4925-8362-3bc6634316c1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:00.189786 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-fd2ff53f-f0d0-4925-8362-3bc6634316c1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1575 microversion: 2.1 time: 0.186188 Aug 05 20:50:00.190359 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 389/814] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:00 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:00.970757 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7ea15c58-4355-457a-8d3d-61a0f97c610a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:00.971407 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7ea15c58-4355-457a-8d3d-61a0f97c610a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:00.979580 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ea15c58-4355-457a-8d3d-61a0f97c610a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:00.980421 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ea15c58-4355-457a-8d3d-61a0f97c610a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:00.980923 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ea15c58-4355-457a-8d3d-61a0f97c610a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:00.981717 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ea15c58-4355-457a-8d3d-61a0f97c610a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:00.982257 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ea15c58-4355-457a-8d3d-61a0f97c610a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:00.982751 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ea15c58-4355-457a-8d3d-61a0f97c610a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:01.122768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7ea15c58-4355-457a-8d3d-61a0f97c610a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:01.131222 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7ea15c58-4355-457a-8d3d-61a0f97c610a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:01.132820 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7ea15c58-4355-457a-8d3d-61a0f97c610a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:01.134921 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7ea15c58-4355-457a-8d3d-61a0f97c610a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1743 microversion: 2.20 time: 0.167891 Aug 05 20:50:01.152034 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 426/815] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:00 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1743 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:01.211745 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9b960d60-3e9a-49a0-896e-21168c1deef1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:01.212355 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9b960d60-3e9a-49a0-896e-21168c1deef1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:01.214890 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=70,nova_api:DELETE=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:01.222038 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9b960d60-3e9a-49a0-896e-21168c1deef1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:01.222836 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9b960d60-3e9a-49a0-896e-21168c1deef1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:01.223503 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9b960d60-3e9a-49a0-896e-21168c1deef1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:01.224432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9b960d60-3e9a-49a0-896e-21168c1deef1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:01.224893 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9b960d60-3e9a-49a0-896e-21168c1deef1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:01.225302 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9b960d60-3e9a-49a0-896e-21168c1deef1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:01.369863 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-9b960d60-3e9a-49a0-896e-21168c1deef1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:01.380598 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9b960d60-3e9a-49a0-896e-21168c1deef1 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1575 microversion: 2.1 time: 0.172693 Aug 05 20:50:01.381181 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 390/816] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:01 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:02.161291 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6db0236a-2729-4d15-a9f1-37e77714c252 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:02.162653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6db0236a-2729-4d15-a9f1-37e77714c252 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:02.171974 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6db0236a-2729-4d15-a9f1-37e77714c252 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:02.172758 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6db0236a-2729-4d15-a9f1-37e77714c252 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:02.173182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6db0236a-2729-4d15-a9f1-37e77714c252 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:02.173881 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6db0236a-2729-4d15-a9f1-37e77714c252 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:02.174487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6db0236a-2729-4d15-a9f1-37e77714c252 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:02.174903 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6db0236a-2729-4d15-a9f1-37e77714c252 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:02.316215 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-03619252-d0e8-4313-a49d-4b527b154a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:02.317372 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-03619252-d0e8-4313-a49d-4b527b154a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:02.327275 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-03619252-d0e8-4313-a49d-4b527b154a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:02.327811 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-03619252-d0e8-4313-a49d-4b527b154a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:02.328255 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-03619252-d0e8-4313-a49d-4b527b154a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:02.328977 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-03619252-d0e8-4313-a49d-4b527b154a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:02.329435 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-03619252-d0e8-4313-a49d-4b527b154a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:02.329862 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-03619252-d0e8-4313-a49d-4b527b154a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:02.330719 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6db0236a-2729-4d15-a9f1-37e77714c252 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:02.340651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6db0236a-2729-4d15-a9f1-37e77714c252 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:02.344032 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6db0236a-2729-4d15-a9f1-37e77714c252 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:02.345909 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6db0236a-2729-4d15-a9f1-37e77714c252 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1743 microversion: 2.20 time: 0.188528 Aug 05 20:50:02.347000 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 427/817] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:02 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1743 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:02.368895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-03619252-d0e8-4313-a49d-4b527b154a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/ips" status: 200 len: 146 microversion: 2.1 time: 0.056559 Aug 05 20:50:02.369481 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 391/818] 10.222.0.100 () {58 vars in 1253 bytes} [Fri Aug 5 20:50:02 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/ips => generated 146 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:50:02.402325 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a44c8a9c-6ef7-469c-9180-e07f5626d124 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:02.403034 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a44c8a9c-6ef7-469c-9180-e07f5626d124 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:02.410444 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a44c8a9c-6ef7-469c-9180-e07f5626d124 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:02.411064 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a44c8a9c-6ef7-469c-9180-e07f5626d124 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:02.411664 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a44c8a9c-6ef7-469c-9180-e07f5626d124 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:02.412400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a44c8a9c-6ef7-469c-9180-e07f5626d124 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:02.412925 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a44c8a9c-6ef7-469c-9180-e07f5626d124 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:02.413629 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a44c8a9c-6ef7-469c-9180-e07f5626d124 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:02.581708 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a44c8a9c-6ef7-469c-9180-e07f5626d124 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:02.590377 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a44c8a9c-6ef7-469c-9180-e07f5626d124 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1575 microversion: 2.1 time: 0.192379 Aug 05 20:50:02.605350 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 428/819] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:02 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:03.370039 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-90fb1457-cacc-4c54-9ece-7efab428af02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:03.370632 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-90fb1457-cacc-4c54-9ece-7efab428af02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:03.378022 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-90fb1457-cacc-4c54-9ece-7efab428af02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:03.378539 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-90fb1457-cacc-4c54-9ece-7efab428af02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:03.378973 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-90fb1457-cacc-4c54-9ece-7efab428af02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:03.379699 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-90fb1457-cacc-4c54-9ece-7efab428af02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:03.380129 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-90fb1457-cacc-4c54-9ece-7efab428af02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:03.380979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-90fb1457-cacc-4c54-9ece-7efab428af02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:03.519836 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-90fb1457-cacc-4c54-9ece-7efab428af02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:03.528818 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-90fb1457-cacc-4c54-9ece-7efab428af02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:03.530528 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-90fb1457-cacc-4c54-9ece-7efab428af02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:03.531721 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-90fb1457-cacc-4c54-9ece-7efab428af02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1743 microversion: 2.20 time: 0.165776 Aug 05 20:50:03.532267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 392/820] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:03 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:03.617184 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-16899a90-87e2-491c-9a69-92088c673b06 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:03.617839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-16899a90-87e2-491c-9a69-92088c673b06 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:03.624677 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-16899a90-87e2-491c-9a69-92088c673b06 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:03.625167 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-16899a90-87e2-491c-9a69-92088c673b06 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:03.625604 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-16899a90-87e2-491c-9a69-92088c673b06 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:03.626294 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-16899a90-87e2-491c-9a69-92088c673b06 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:03.626743 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-16899a90-87e2-491c-9a69-92088c673b06 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:03.627164 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-16899a90-87e2-491c-9a69-92088c673b06 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:03.779067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-16899a90-87e2-491c-9a69-92088c673b06 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:03.786761 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-16899a90-87e2-491c-9a69-92088c673b06 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1575 microversion: 2.1 time: 0.176521 Aug 05 20:50:03.787613 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 429/821] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:03 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:03.792770 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-11a35aec-f117-43e8-b1e3-39dfa7280291 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0cffa84-2c20-467b-bdce-0d0b69d5eba8"}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:03.795155 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-11a35aec-f117-43e8-b1e3-39dfa7280291 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:03.801525 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-11a35aec-f117-43e8-b1e3-39dfa7280291 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:03.802008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-11a35aec-f117-43e8-b1e3-39dfa7280291 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:03.802446 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-11a35aec-f117-43e8-b1e3-39dfa7280291 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:03.803126 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-11a35aec-f117-43e8-b1e3-39dfa7280291 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:03.803609 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-11a35aec-f117-43e8-b1e3-39dfa7280291 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:03.804069 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-11a35aec-f117-43e8-b1e3-39dfa7280291 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:04.153468 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-11a35aec-f117-43e8-b1e3-39dfa7280291 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "POST /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364334 Aug 05 20:50:04.154157 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 393/822] 10.222.0.100 () {60 vars in 1328 bytes} [Fri Aug 5 20:50:03 2022] POST /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:04.556158 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6784a5db-bce7-4af3-a97b-560dc1c3d0c4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:04.556772 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6784a5db-bce7-4af3-a97b-560dc1c3d0c4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:04.562974 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6784a5db-bce7-4af3-a97b-560dc1c3d0c4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:04.563461 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6784a5db-bce7-4af3-a97b-560dc1c3d0c4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:04.563877 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6784a5db-bce7-4af3-a97b-560dc1c3d0c4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:04.564786 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6784a5db-bce7-4af3-a97b-560dc1c3d0c4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:04.565366 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6784a5db-bce7-4af3-a97b-560dc1c3d0c4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:04.565769 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6784a5db-bce7-4af3-a97b-560dc1c3d0c4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:04.705310 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6784a5db-bce7-4af3-a97b-560dc1c3d0c4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:04.714401 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6784a5db-bce7-4af3-a97b-560dc1c3d0c4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:04.715954 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6784a5db-bce7-4af3-a97b-560dc1c3d0c4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:04.717858 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6784a5db-bce7-4af3-a97b-560dc1c3d0c4 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1725 microversion: 2.20 time: 0.166886 Aug 05 20:50:04.718421 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 430/823] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:04 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:04.810049 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-19d73d87-0856-42af-b0b2-9430ac12b6cb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:04.811188 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-19d73d87-0856-42af-b0b2-9430ac12b6cb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:04.818224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-19d73d87-0856-42af-b0b2-9430ac12b6cb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:04.818717 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-19d73d87-0856-42af-b0b2-9430ac12b6cb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:04.819161 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-19d73d87-0856-42af-b0b2-9430ac12b6cb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:04.819897 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-19d73d87-0856-42af-b0b2-9430ac12b6cb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:04.820349 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-19d73d87-0856-42af-b0b2-9430ac12b6cb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:04.820866 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-19d73d87-0856-42af-b0b2-9430ac12b6cb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:04.955463 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-19d73d87-0856-42af-b0b2-9430ac12b6cb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:04.963515 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-19d73d87-0856-42af-b0b2-9430ac12b6cb tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1575 microversion: 2.1 time: 0.159266 Aug 05 20:50:04.965383 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 394/824] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:04 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:05.744827 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1b215174-2877-4bac-af36-92bcff633695 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:05.745534 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1b215174-2877-4bac-af36-92bcff633695 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:05.752220 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b215174-2877-4bac-af36-92bcff633695 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:05.752707 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b215174-2877-4bac-af36-92bcff633695 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:05.753138 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b215174-2877-4bac-af36-92bcff633695 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:05.753834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b215174-2877-4bac-af36-92bcff633695 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:05.754313 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b215174-2877-4bac-af36-92bcff633695 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:05.754709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1b215174-2877-4bac-af36-92bcff633695 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:05.897649 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1b215174-2877-4bac-af36-92bcff633695 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:05.906523 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1b215174-2877-4bac-af36-92bcff633695 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:05.908069 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1b215174-2877-4bac-af36-92bcff633695 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:05.909232 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1b215174-2877-4bac-af36-92bcff633695 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1725 microversion: 2.20 time: 0.170106 Aug 05 20:50:05.909766 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 431/825] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:05 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:05.985831 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e94d408c-88b1-4a84-b04d-deda41342ecf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:05.986462 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e94d408c-88b1-4a84-b04d-deda41342ecf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:05.993514 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e94d408c-88b1-4a84-b04d-deda41342ecf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:05.994009 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e94d408c-88b1-4a84-b04d-deda41342ecf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:05.994453 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e94d408c-88b1-4a84-b04d-deda41342ecf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:05.995218 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e94d408c-88b1-4a84-b04d-deda41342ecf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:05.995644 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e94d408c-88b1-4a84-b04d-deda41342ecf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:05.996080 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e94d408c-88b1-4a84-b04d-deda41342ecf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:06.146239 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-e94d408c-88b1-4a84-b04d-deda41342ecf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:06.158869 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e94d408c-88b1-4a84-b04d-deda41342ecf tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1575 microversion: 2.1 time: 0.176744 Aug 05 20:50:06.159713 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 395/826] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:05 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:06.543811 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-1af9c1ac-684e-4688-95ea-78f2666b8fa0 req-d0f84f37-2b46-49c1-868e-be37b1b067fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12ad125-6f29-4ee3-971f-d1c23391c89f", "name": "network-vif-plugged", "status": "completed", "tag": "aca05bcd-9297-4365-a6e9-dca538228f87"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:06.555153 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-1af9c1ac-684e-4688-95ea-78f2666b8fa0 req-d0f84f37-2b46-49c1-868e-be37b1b067fe service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:06.556005 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-1af9c1ac-684e-4688-95ea-78f2666b8fa0 req-d0f84f37-2b46-49c1-868e-be37b1b067fe service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:06.556138 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-1af9c1ac-684e-4688-95ea-78f2666b8fa0 req-d0f84f37-2b46-49c1-868e-be37b1b067fe service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:06.567639 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-1af9c1ac-684e-4688-95ea-78f2666b8fa0 req-d0f84f37-2b46-49c1-868e-be37b1b067fe service nova] Creating event network-vif-plugged:aca05bcd-9297-4365-a6e9-dca538228f87 for instance c12ad125-6f29-4ee3-971f-d1c23391c89f on hv-cinder-85220 Aug 05 20:50:06.572606 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-1af9c1ac-684e-4688-95ea-78f2666b8fa0 req-d0f84f37-2b46-49c1-868e-be37b1b067fe service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033542 Aug 05 20:50:06.573199 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 432/827] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:06.934260 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7f31b540-5845-447e-910b-9396a5ac8f02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:06.934878 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-7f31b540-5845-447e-910b-9396a5ac8f02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:06.941418 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7f31b540-5845-447e-910b-9396a5ac8f02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:06.941906 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7f31b540-5845-447e-910b-9396a5ac8f02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:06.942344 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7f31b540-5845-447e-910b-9396a5ac8f02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:06.943043 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7f31b540-5845-447e-910b-9396a5ac8f02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:06.943533 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7f31b540-5845-447e-910b-9396a5ac8f02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:06.943960 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7f31b540-5845-447e-910b-9396a5ac8f02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:07.165140 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7f31b540-5845-447e-910b-9396a5ac8f02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:07.175322 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7f31b540-5845-447e-910b-9396a5ac8f02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:07.176861 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7f31b540-5845-447e-910b-9396a5ac8f02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:07.178020 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-7f31b540-5845-447e-910b-9396a5ac8f02 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1668 microversion: 2.20 time: 0.247878 Aug 05 20:50:07.178645 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 396/828] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:06 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1668 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:07.182185 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e4d6435d-e738-4c7b-90fd-637a1806bdd8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:07.182889 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e4d6435d-e738-4c7b-90fd-637a1806bdd8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:07.189509 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4d6435d-e738-4c7b-90fd-637a1806bdd8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:07.189998 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4d6435d-e738-4c7b-90fd-637a1806bdd8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:07.190435 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4d6435d-e738-4c7b-90fd-637a1806bdd8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:07.191127 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4d6435d-e738-4c7b-90fd-637a1806bdd8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:07.191755 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4d6435d-e738-4c7b-90fd-637a1806bdd8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:07.192267 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4d6435d-e738-4c7b-90fd-637a1806bdd8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:07.200343 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4a1f1ffc-3623-49a9-b77e-910060576f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90601279-b8d8-4c54-b679-05b3e754050d"}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:07.202742 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4a1f1ffc-3623-49a9-b77e-910060576f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:07.208788 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4a1f1ffc-3623-49a9-b77e-910060576f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:07.209263 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4a1f1ffc-3623-49a9-b77e-910060576f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:07.209696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4a1f1ffc-3623-49a9-b77e-910060576f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:07.210628 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4a1f1ffc-3623-49a9-b77e-910060576f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:07.211102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4a1f1ffc-3623-49a9-b77e-910060576f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:07.211536 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4a1f1ffc-3623-49a9-b77e-910060576f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:07.334454 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e4d6435d-e738-4c7b-90fd-637a1806bdd8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:07.343130 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e4d6435d-e738-4c7b-90fd-637a1806bdd8 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1575 microversion: 2.1 time: 0.165641 Aug 05 20:50:07.344099 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 433/829] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:07 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:07.410800 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:07.536260 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4a1f1ffc-3623-49a9-b77e-910060576f5e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "POST /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.339801 Aug 05 20:50:07.536863 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 397/830] 10.222.0.100 () {62 vars in 1369 bytes} [Fri Aug 5 20:50:07 2022] POST /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d/os-volume_attachments => generated 188 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 20:50:07.660665 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-18dc1aa9-1c8e-4784-b169-90f5f3bd009e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:07.661166 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-18dc1aa9-1c8e-4784-b169-90f5f3bd009e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:07.670072 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-18dc1aa9-1c8e-4784-b169-90f5f3bd009e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:07.670714 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-18dc1aa9-1c8e-4784-b169-90f5f3bd009e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:07.671406 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-18dc1aa9-1c8e-4784-b169-90f5f3bd009e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:07.672389 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-18dc1aa9-1c8e-4784-b169-90f5f3bd009e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:07.673047 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-18dc1aa9-1c8e-4784-b169-90f5f3bd009e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:07.673633 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-18dc1aa9-1c8e-4784-b169-90f5f3bd009e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:07.935527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:07.946971 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-18dc1aa9-1c8e-4784-b169-90f5f3bd009e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "DELETE /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d/os-volume_attachments/90601279-b8d8-4c54-b679-05b3e754050d" status: 202 len: 0 microversion: 2.20 time: 0.290311 Aug 05 20:50:07.948415 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 434/831] 10.222.0.100 () {60 vars in 1462 bytes} [Fri Aug 5 20:50:07 2022] DELETE /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d/os-volume_attachments/90601279-b8d8-4c54-b679-05b3e754050d => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:50:08.013562 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ebbded3b-d2eb-4e4c-8c7f-6bb4caa19a29 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:08.014162 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ebbded3b-d2eb-4e4c-8c7f-6bb4caa19a29 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:08.021404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ebbded3b-d2eb-4e4c-8c7f-6bb4caa19a29 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:08.021892 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ebbded3b-d2eb-4e4c-8c7f-6bb4caa19a29 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:08.022350 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ebbded3b-d2eb-4e4c-8c7f-6bb4caa19a29 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:08.023202 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ebbded3b-d2eb-4e4c-8c7f-6bb4caa19a29 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:08.023697 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ebbded3b-d2eb-4e4c-8c7f-6bb4caa19a29 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:08.024182 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ebbded3b-d2eb-4e4c-8c7f-6bb4caa19a29 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:08.054518 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ebbded3b-d2eb-4e4c-8c7f-6bb4caa19a29 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124431) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 20:50:08.127401 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ebbded3b-d2eb-4e4c-8c7f-6bb4caa19a29 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "POST /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d/action" status: 202 len: 0 microversion: 2.20 time: 0.115918 Aug 05 20:50:08.127401 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 398/832] 10.222.0.100 () {62 vars in 1324 bytes} [Fri Aug 5 20:50:08 2022] POST /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:50:08.142463 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cd085765-a031-450d-9ee7-800a657b423f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:08.143183 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cd085765-a031-450d-9ee7-800a657b423f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:08.151111 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cd085765-a031-450d-9ee7-800a657b423f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:08.152250 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cd085765-a031-450d-9ee7-800a657b423f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:08.152918 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cd085765-a031-450d-9ee7-800a657b423f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:08.153715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cd085765-a031-450d-9ee7-800a657b423f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:08.154167 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cd085765-a031-450d-9ee7-800a657b423f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:08.154807 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cd085765-a031-450d-9ee7-800a657b423f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:08.298719 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cd085765-a031-450d-9ee7-800a657b423f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:08.307516 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cd085765-a031-450d-9ee7-800a657b423f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:08.309061 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cd085765-a031-450d-9ee7-800a657b423f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:08.310221 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cd085765-a031-450d-9ee7-800a657b423f tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1676 microversion: 2.20 time: 0.179771 Aug 05 20:50:08.310778 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 435/833] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:08 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:08.365066 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-2a072be3-2cb0-4ee2-85e0-d287458b6601 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:08.365653 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-2a072be3-2cb0-4ee2-85e0-d287458b6601 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:08.372601 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2a072be3-2cb0-4ee2-85e0-d287458b6601 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:08.373417 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2a072be3-2cb0-4ee2-85e0-d287458b6601 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:08.374045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2a072be3-2cb0-4ee2-85e0-d287458b6601 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:08.374831 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2a072be3-2cb0-4ee2-85e0-d287458b6601 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:08.375587 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2a072be3-2cb0-4ee2-85e0-d287458b6601 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:08.376273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2a072be3-2cb0-4ee2-85e0-d287458b6601 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:08.529903 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-2a072be3-2cb0-4ee2-85e0-d287458b6601 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:08.538768 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-2a072be3-2cb0-4ee2-85e0-d287458b6601 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1575 microversion: 2.1 time: 0.177198 Aug 05 20:50:08.552972 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 399/834] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:08 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:08.560418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0bc492b8-dd3c-4fe9-91cb-1d10db7220e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:08.561064 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0bc492b8-dd3c-4fe9-91cb-1d10db7220e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:08.562929 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:08.571160 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0bc492b8-dd3c-4fe9-91cb-1d10db7220e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:08.571675 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0bc492b8-dd3c-4fe9-91cb-1d10db7220e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:08.572309 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0bc492b8-dd3c-4fe9-91cb-1d10db7220e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:08.573195 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0bc492b8-dd3c-4fe9-91cb-1d10db7220e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:08.573795 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0bc492b8-dd3c-4fe9-91cb-1d10db7220e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:08.574366 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0bc492b8-dd3c-4fe9-91cb-1d10db7220e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:08.623410 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-2cb259fa-2d00-41cf-a59e-62e3afc09bc9 req-3b835180-480a-4296-93de-c0a04f93e634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe498615-6695-4746-89be-48a9e31f6b4d", "name": "network-vif-unplugged", "status": "completed", "tag": "5596f6df-3385-436f-9183-b31838466a7c"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:08.639446 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-2cb259fa-2d00-41cf-a59e-62e3afc09bc9 req-3b835180-480a-4296-93de-c0a04f93e634 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:08.643559 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-2cb259fa-2d00-41cf-a59e-62e3afc09bc9 req-3b835180-480a-4296-93de-c0a04f93e634 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:08.644221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-2cb259fa-2d00-41cf-a59e-62e3afc09bc9 req-3b835180-480a-4296-93de-c0a04f93e634 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:08.672296 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.compute.server_external_events [req-2cb259fa-2d00-41cf-a59e-62e3afc09bc9 req-3b835180-480a-4296-93de-c0a04f93e634 service nova] Unable to find a host for instance fe498615-6695-4746-89be-48a9e31f6b4d. Dropping event network-vif-unplugged {{(pid=124431) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 20:50:08.674803 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-2cb259fa-2d00-41cf-a59e-62e3afc09bc9 req-3b835180-480a-4296-93de-c0a04f93e634 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.056840 Aug 05 20:50:08.676964 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 400/835] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 05 20:50:08.692046 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-0bc492b8-dd3c-4fe9-91cb-1d10db7220e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lazy-loading 'services' on Instance uuid c34d5df9-1498-4fdd-a688-5d8bad899a6f {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:50:08.834256 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0bc492b8-dd3c-4fe9-91cb-1d10db7220e0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments/ce3bbd68-ce90-45c7-8930-427ba6217cbc" status: 202 len: 0 microversion: 2.1 time: 0.277293 Aug 05 20:50:08.834927 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 436/836] 10.222.0.100 () {58 vars in 1421 bytes} [Fri Aug 5 20:50:08 2022] DELETE /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments/ce3bbd68-ce90-45c7-8930-427ba6217cbc => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:50:08.843496 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-fc9ced82-5328-4083-a665-79ce0e2b200f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:08.846269 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-fc9ced82-5328-4083-a665-79ce0e2b200f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:08.852595 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fc9ced82-5328-4083-a665-79ce0e2b200f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:08.853068 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fc9ced82-5328-4083-a665-79ce0e2b200f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:08.853503 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fc9ced82-5328-4083-a665-79ce0e2b200f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:08.854191 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fc9ced82-5328-4083-a665-79ce0e2b200f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:08.854666 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fc9ced82-5328-4083-a665-79ce0e2b200f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:08.855080 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fc9ced82-5328-4083-a665-79ce0e2b200f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:08.884664 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-fc9ced82-5328-4083-a665-79ce0e2b200f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045023 Aug 05 20:50:08.885241 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 401/837] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:08 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:09.334243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f9bdfb02-c10b-41e0-bfc5-7ad4492f93f5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:09.334947 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f9bdfb02-c10b-41e0-bfc5-7ad4492f93f5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:09.341796 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9bdfb02-c10b-41e0-bfc5-7ad4492f93f5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:09.342283 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9bdfb02-c10b-41e0-bfc5-7ad4492f93f5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:09.342719 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9bdfb02-c10b-41e0-bfc5-7ad4492f93f5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:09.343437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9bdfb02-c10b-41e0-bfc5-7ad4492f93f5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:09.343912 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9bdfb02-c10b-41e0-bfc5-7ad4492f93f5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:09.344334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f9bdfb02-c10b-41e0-bfc5-7ad4492f93f5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:09.482084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f9bdfb02-c10b-41e0-bfc5-7ad4492f93f5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:09.491708 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f9bdfb02-c10b-41e0-bfc5-7ad4492f93f5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:09.493686 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f9bdfb02-c10b-41e0-bfc5-7ad4492f93f5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:09.494905 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f9bdfb02-c10b-41e0-bfc5-7ad4492f93f5 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.165187 Aug 05 20:50:09.495812 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 437/838] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:09 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:09.578162 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3709d0ab-369a-4219-99db-bc35bfb7a30d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:09.579087 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3709d0ab-369a-4219-99db-bc35bfb7a30d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:09.588300 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3709d0ab-369a-4219-99db-bc35bfb7a30d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:09.588785 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3709d0ab-369a-4219-99db-bc35bfb7a30d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:09.589224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3709d0ab-369a-4219-99db-bc35bfb7a30d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:09.589928 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3709d0ab-369a-4219-99db-bc35bfb7a30d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:09.590388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3709d0ab-369a-4219-99db-bc35bfb7a30d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:09.590818 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3709d0ab-369a-4219-99db-bc35bfb7a30d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:09.761457 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3709d0ab-369a-4219-99db-bc35bfb7a30d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:09.770684 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3709d0ab-369a-4219-99db-bc35bfb7a30d tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1562 microversion: 2.1 time: 0.199014 Aug 05 20:50:09.771447 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 402/839] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:09 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1562 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:09.902526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fb649838-1185-4042-9feb-888989ec4e37 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:09.906378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fb649838-1185-4042-9feb-888989ec4e37 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:09.916162 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb649838-1185-4042-9feb-888989ec4e37 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:09.916648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb649838-1185-4042-9feb-888989ec4e37 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:09.917080 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb649838-1185-4042-9feb-888989ec4e37 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:09.917781 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb649838-1185-4042-9feb-888989ec4e37 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:09.918263 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb649838-1185-4042-9feb-888989ec4e37 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:09.918687 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb649838-1185-4042-9feb-888989ec4e37 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:09.949527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fb649838-1185-4042-9feb-888989ec4e37 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055290 Aug 05 20:50:09.950066 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 438/840] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:09 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:10.518386 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-feb866d6-548e-4d60-a785-ad490325e95d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:10.519036 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-feb866d6-548e-4d60-a785-ad490325e95d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:10.526165 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-feb866d6-548e-4d60-a785-ad490325e95d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:10.527017 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-feb866d6-548e-4d60-a785-ad490325e95d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:10.527594 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-feb866d6-548e-4d60-a785-ad490325e95d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:10.528627 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-feb866d6-548e-4d60-a785-ad490325e95d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:10.529123 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-feb866d6-548e-4d60-a785-ad490325e95d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:10.529548 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-feb866d6-548e-4d60-a785-ad490325e95d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:10.675265 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-feb866d6-548e-4d60-a785-ad490325e95d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:10.685691 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-feb866d6-548e-4d60-a785-ad490325e95d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:10.687185 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-feb866d6-548e-4d60-a785-ad490325e95d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:10.688554 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-feb866d6-548e-4d60-a785-ad490325e95d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.174345 Aug 05 20:50:10.689535 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 403/841] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:10 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:10.963954 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f5360c1f-3ca0-497b-aa26-0aaecf824208 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:10.965878 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f5360c1f-3ca0-497b-aa26-0aaecf824208 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:10.972411 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f5360c1f-3ca0-497b-aa26-0aaecf824208 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:10.972917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f5360c1f-3ca0-497b-aa26-0aaecf824208 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:10.973353 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f5360c1f-3ca0-497b-aa26-0aaecf824208 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:10.974051 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f5360c1f-3ca0-497b-aa26-0aaecf824208 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:10.974501 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f5360c1f-3ca0-497b-aa26-0aaecf824208 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:10.975382 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f5360c1f-3ca0-497b-aa26-0aaecf824208 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:11.016922 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f5360c1f-3ca0-497b-aa26-0aaecf824208 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057184 Aug 05 20:50:11.017819 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 439/842] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:10 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:11.714360 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-580fa9e9-cfcd-40d2-baf4-2446d4ff9938 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:11.715062 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-580fa9e9-cfcd-40d2-baf4-2446d4ff9938 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:11.721839 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-580fa9e9-cfcd-40d2-baf4-2446d4ff9938 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:11.722333 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-580fa9e9-cfcd-40d2-baf4-2446d4ff9938 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:11.722797 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-580fa9e9-cfcd-40d2-baf4-2446d4ff9938 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:11.723569 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-580fa9e9-cfcd-40d2-baf4-2446d4ff9938 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:11.724022 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-580fa9e9-cfcd-40d2-baf4-2446d4ff9938 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:11.724448 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-580fa9e9-cfcd-40d2-baf4-2446d4ff9938 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:12.033233 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8ffb0098-7582-415f-b452-510458461f48 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:12.034266 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-580fa9e9-cfcd-40d2-baf4-2446d4ff9938 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:12.035393 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8ffb0098-7582-415f-b452-510458461f48 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:12.042748 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ffb0098-7582-415f-b452-510458461f48 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:12.043519 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ffb0098-7582-415f-b452-510458461f48 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:12.044140 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ffb0098-7582-415f-b452-510458461f48 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:12.044892 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-580fa9e9-cfcd-40d2-baf4-2446d4ff9938 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:12.045194 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ffb0098-7582-415f-b452-510458461f48 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:12.045493 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ffb0098-7582-415f-b452-510458461f48 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:12.045913 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8ffb0098-7582-415f-b452-510458461f48 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:12.047759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-580fa9e9-cfcd-40d2-baf4-2446d4ff9938 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:12.049314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-580fa9e9-cfcd-40d2-baf4-2446d4ff9938 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.339149 Aug 05 20:50:12.050059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 404/843] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:11 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:12.080310 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8ffb0098-7582-415f-b452-510458461f48 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051364 Aug 05 20:50:12.085407 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 440/844] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:12 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:50:13.074697 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-30f5f97c-87e5-4d2c-b1a1-ddc7e2dfd092 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:13.075495 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-30f5f97c-87e5-4d2c-b1a1-ddc7e2dfd092 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:13.082968 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-30f5f97c-87e5-4d2c-b1a1-ddc7e2dfd092 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:13.083484 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-30f5f97c-87e5-4d2c-b1a1-ddc7e2dfd092 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:13.083922 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-30f5f97c-87e5-4d2c-b1a1-ddc7e2dfd092 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:13.084633 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-30f5f97c-87e5-4d2c-b1a1-ddc7e2dfd092 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:13.085576 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-30f5f97c-87e5-4d2c-b1a1-ddc7e2dfd092 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:13.085576 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-30f5f97c-87e5-4d2c-b1a1-ddc7e2dfd092 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:13.093472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f574cc3d-0d90-47ec-9121-7a407bdb765e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:13.096759 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f574cc3d-0d90-47ec-9121-7a407bdb765e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:13.106228 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f574cc3d-0d90-47ec-9121-7a407bdb765e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:13.107229 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f574cc3d-0d90-47ec-9121-7a407bdb765e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:13.107941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f574cc3d-0d90-47ec-9121-7a407bdb765e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:13.108891 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f574cc3d-0d90-47ec-9121-7a407bdb765e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:13.109714 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f574cc3d-0d90-47ec-9121-7a407bdb765e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:13.110360 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f574cc3d-0d90-47ec-9121-7a407bdb765e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:13.148585 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f574cc3d-0d90-47ec-9121-7a407bdb765e tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059399 Aug 05 20:50:13.149504 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 441/845] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:13 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:13.225672 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-30f5f97c-87e5-4d2c-b1a1-ddc7e2dfd092 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:13.234671 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-30f5f97c-87e5-4d2c-b1a1-ddc7e2dfd092 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:13.236392 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-30f5f97c-87e5-4d2c-b1a1-ddc7e2dfd092 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:13.237577 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-30f5f97c-87e5-4d2c-b1a1-ddc7e2dfd092 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.167369 Aug 05 20:50:13.238090 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 405/846] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:13 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:14.161485 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e4967616-399e-4766-909e-2378e536c56a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:14.163996 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e4967616-399e-4766-909e-2378e536c56a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:14.170965 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4967616-399e-4766-909e-2378e536c56a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:14.171491 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4967616-399e-4766-909e-2378e536c56a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:14.172079 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4967616-399e-4766-909e-2378e536c56a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:14.172869 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4967616-399e-4766-909e-2378e536c56a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:14.173265 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4967616-399e-4766-909e-2378e536c56a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:14.173692 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e4967616-399e-4766-909e-2378e536c56a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:14.261693 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-54510a99-a1e2-435b-bf3c-6444dbbddb8a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:14.262527 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-54510a99-a1e2-435b-bf3c-6444dbbddb8a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:14.269773 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54510a99-a1e2-435b-bf3c-6444dbbddb8a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:14.270266 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54510a99-a1e2-435b-bf3c-6444dbbddb8a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:14.270707 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54510a99-a1e2-435b-bf3c-6444dbbddb8a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:14.271449 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54510a99-a1e2-435b-bf3c-6444dbbddb8a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:14.271907 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54510a99-a1e2-435b-bf3c-6444dbbddb8a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:14.272399 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54510a99-a1e2-435b-bf3c-6444dbbddb8a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:14.376730 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e4967616-399e-4766-909e-2378e536c56a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.219222 Aug 05 20:50:14.378806 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 442/847] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:14 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:14.431767 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-54510a99-a1e2-435b-bf3c-6444dbbddb8a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:14.441622 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-54510a99-a1e2-435b-bf3c-6444dbbddb8a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:14.443646 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-54510a99-a1e2-435b-bf3c-6444dbbddb8a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:14.445259 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-54510a99-a1e2-435b-bf3c-6444dbbddb8a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.188125 Aug 05 20:50:14.447400 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 406/848] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:14 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:50:15.389452 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-65fff32f-d61c-4503-83b4-9b03b0e21166 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:15.391884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-65fff32f-d61c-4503-83b4-9b03b0e21166 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:15.399530 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-65fff32f-d61c-4503-83b4-9b03b0e21166 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:15.400026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-65fff32f-d61c-4503-83b4-9b03b0e21166 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:15.400559 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-65fff32f-d61c-4503-83b4-9b03b0e21166 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:15.401406 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-65fff32f-d61c-4503-83b4-9b03b0e21166 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:15.402184 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-65fff32f-d61c-4503-83b4-9b03b0e21166 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:15.402611 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-65fff32f-d61c-4503-83b4-9b03b0e21166 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:15.437203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-65fff32f-d61c-4503-83b4-9b03b0e21166 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051735 Aug 05 20:50:15.438115 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 443/849] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:15 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:15.468534 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ac797415-7b68-4d59-9fac-f464aaa87242 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:15.469227 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ac797415-7b68-4d59-9fac-f464aaa87242 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:15.476402 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ac797415-7b68-4d59-9fac-f464aaa87242 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:15.477021 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ac797415-7b68-4d59-9fac-f464aaa87242 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:15.477423 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ac797415-7b68-4d59-9fac-f464aaa87242 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:15.478126 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ac797415-7b68-4d59-9fac-f464aaa87242 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:15.478573 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ac797415-7b68-4d59-9fac-f464aaa87242 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:15.478996 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ac797415-7b68-4d59-9fac-f464aaa87242 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:15.624509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ac797415-7b68-4d59-9fac-f464aaa87242 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:15.633669 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ac797415-7b68-4d59-9fac-f464aaa87242 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:15.635206 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ac797415-7b68-4d59-9fac-f464aaa87242 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:15.636428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ac797415-7b68-4d59-9fac-f464aaa87242 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.171872 Aug 05 20:50:15.636982 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 407/850] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:15 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:16.450749 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6c491527-0241-45e5-b303-badac505e307 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:16.453040 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6c491527-0241-45e5-b303-badac505e307 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:16.460052 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6c491527-0241-45e5-b303-badac505e307 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:16.461004 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6c491527-0241-45e5-b303-badac505e307 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:16.461004 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6c491527-0241-45e5-b303-badac505e307 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:16.461714 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6c491527-0241-45e5-b303-badac505e307 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:16.462195 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6c491527-0241-45e5-b303-badac505e307 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:16.462830 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6c491527-0241-45e5-b303-badac505e307 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:16.499341 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6c491527-0241-45e5-b303-badac505e307 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052642 Aug 05 20:50:16.499984 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 444/851] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:16 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:16.662695 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-499e4ebc-94a9-4616-a012-a7d4b0ce0c79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:16.663611 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-499e4ebc-94a9-4616-a012-a7d4b0ce0c79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:16.671064 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-499e4ebc-94a9-4616-a012-a7d4b0ce0c79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:16.671592 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-499e4ebc-94a9-4616-a012-a7d4b0ce0c79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:16.672039 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-499e4ebc-94a9-4616-a012-a7d4b0ce0c79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:16.672951 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-499e4ebc-94a9-4616-a012-a7d4b0ce0c79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:16.673531 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-499e4ebc-94a9-4616-a012-a7d4b0ce0c79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:16.673981 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-499e4ebc-94a9-4616-a012-a7d4b0ce0c79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:16.825190 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-499e4ebc-94a9-4616-a012-a7d4b0ce0c79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:16.833633 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-499e4ebc-94a9-4616-a012-a7d4b0ce0c79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:16.835377 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-499e4ebc-94a9-4616-a012-a7d4b0ce0c79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:16.836676 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-499e4ebc-94a9-4616-a012-a7d4b0ce0c79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.177995 Aug 05 20:50:16.851393 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 408/852] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:16 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:17.512682 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-da966fea-a9ce-42ca-b990-4413d382e07f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:17.514839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-da966fea-a9ce-42ca-b990-4413d382e07f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:17.521971 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da966fea-a9ce-42ca-b990-4413d382e07f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:17.522477 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da966fea-a9ce-42ca-b990-4413d382e07f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:17.522964 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da966fea-a9ce-42ca-b990-4413d382e07f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:17.523731 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da966fea-a9ce-42ca-b990-4413d382e07f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:17.524191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da966fea-a9ce-42ca-b990-4413d382e07f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:17.524627 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da966fea-a9ce-42ca-b990-4413d382e07f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:17.557862 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-da966fea-a9ce-42ca-b990-4413d382e07f tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049119 Aug 05 20:50:17.558469 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 445/853] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:17 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:50:17.860939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ad240f10-e579-477f-9c15-b39d96520448 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:17.861867 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ad240f10-e579-477f-9c15-b39d96520448 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:17.869209 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad240f10-e579-477f-9c15-b39d96520448 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:17.869995 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad240f10-e579-477f-9c15-b39d96520448 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:17.870421 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad240f10-e579-477f-9c15-b39d96520448 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:17.871321 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad240f10-e579-477f-9c15-b39d96520448 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:17.871815 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad240f10-e579-477f-9c15-b39d96520448 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:17.872588 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad240f10-e579-477f-9c15-b39d96520448 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:18.029547 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ad240f10-e579-477f-9c15-b39d96520448 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:18.038325 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ad240f10-e579-477f-9c15-b39d96520448 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:18.040099 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ad240f10-e579-477f-9c15-b39d96520448 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:18.041309 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ad240f10-e579-477f-9c15-b39d96520448 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.184504 Aug 05 20:50:18.042192 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 409/854] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:17 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:18.572643 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-146eae7d-ec8f-4df4-a351-19affd7f2fcf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:18.574705 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-146eae7d-ec8f-4df4-a351-19affd7f2fcf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:18.581396 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-146eae7d-ec8f-4df4-a351-19affd7f2fcf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:18.582141 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-146eae7d-ec8f-4df4-a351-19affd7f2fcf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:18.582757 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-146eae7d-ec8f-4df4-a351-19affd7f2fcf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:18.583496 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-146eae7d-ec8f-4df4-a351-19affd7f2fcf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:18.583946 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-146eae7d-ec8f-4df4-a351-19affd7f2fcf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:18.584361 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-146eae7d-ec8f-4df4-a351-19affd7f2fcf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:18.617249 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-146eae7d-ec8f-4df4-a351-19affd7f2fcf tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049108 Aug 05 20:50:18.617811 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 446/855] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:18 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:19.065543 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a46595c4-ca7d-4ed6-be5b-526c1b0a87ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:19.066203 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a46595c4-ca7d-4ed6-be5b-526c1b0a87ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:19.073907 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a46595c4-ca7d-4ed6-be5b-526c1b0a87ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:19.074407 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a46595c4-ca7d-4ed6-be5b-526c1b0a87ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:19.074841 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a46595c4-ca7d-4ed6-be5b-526c1b0a87ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:19.075628 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a46595c4-ca7d-4ed6-be5b-526c1b0a87ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:19.076086 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a46595c4-ca7d-4ed6-be5b-526c1b0a87ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:19.076526 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a46595c4-ca7d-4ed6-be5b-526c1b0a87ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:19.219312 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a46595c4-ca7d-4ed6-be5b-526c1b0a87ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:19.227840 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a46595c4-ca7d-4ed6-be5b-526c1b0a87ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:19.229334 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a46595c4-ca7d-4ed6-be5b-526c1b0a87ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:19.230502 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a46595c4-ca7d-4ed6-be5b-526c1b0a87ce tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.169427 Aug 05 20:50:19.231066 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 410/856] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:19 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:19.634217 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-587d6c08-295a-4b59-96f8-daba3691322d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:19.636832 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-587d6c08-295a-4b59-96f8-daba3691322d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:19.644047 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-587d6c08-295a-4b59-96f8-daba3691322d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:19.644547 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-587d6c08-295a-4b59-96f8-daba3691322d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:19.644990 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-587d6c08-295a-4b59-96f8-daba3691322d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:19.645689 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-587d6c08-295a-4b59-96f8-daba3691322d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:19.646134 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-587d6c08-295a-4b59-96f8-daba3691322d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:19.646530 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-587d6c08-295a-4b59-96f8-daba3691322d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:19.677585 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-587d6c08-295a-4b59-96f8-daba3691322d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050441 Aug 05 20:50:19.678128 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 447/857] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:19 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:20.254144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c29701bb-f18e-4052-a571-8cebe2b18074 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:20.254726 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c29701bb-f18e-4052-a571-8cebe2b18074 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:20.262011 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c29701bb-f18e-4052-a571-8cebe2b18074 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:20.262502 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c29701bb-f18e-4052-a571-8cebe2b18074 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:20.262941 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c29701bb-f18e-4052-a571-8cebe2b18074 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:20.263681 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c29701bb-f18e-4052-a571-8cebe2b18074 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:20.264140 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c29701bb-f18e-4052-a571-8cebe2b18074 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:20.264571 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c29701bb-f18e-4052-a571-8cebe2b18074 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:20.401314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c29701bb-f18e-4052-a571-8cebe2b18074 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:20.410392 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c29701bb-f18e-4052-a571-8cebe2b18074 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:20.411944 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-c29701bb-f18e-4052-a571-8cebe2b18074 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:20.413125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c29701bb-f18e-4052-a571-8cebe2b18074 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.163113 Aug 05 20:50:20.413711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 411/858] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:20 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:20.696068 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5dddeaf3-2613-4fa6-8b91-d4b8b0e32275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:20.701236 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5dddeaf3-2613-4fa6-8b91-d4b8b0e32275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:20.715736 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5dddeaf3-2613-4fa6-8b91-d4b8b0e32275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:20.716455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5dddeaf3-2613-4fa6-8b91-d4b8b0e32275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:20.717097 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5dddeaf3-2613-4fa6-8b91-d4b8b0e32275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:20.718096 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5dddeaf3-2613-4fa6-8b91-d4b8b0e32275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:20.718772 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5dddeaf3-2613-4fa6-8b91-d4b8b0e32275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:20.719399 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5dddeaf3-2613-4fa6-8b91-d4b8b0e32275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:20.760968 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5dddeaf3-2613-4fa6-8b91-d4b8b0e32275 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072841 Aug 05 20:50:20.761539 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 448/859] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:20 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:21.438522 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f9d9ed49-c64d-4c9d-90df-c2fc5920304d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:21.439158 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f9d9ed49-c64d-4c9d-90df-c2fc5920304d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:21.446491 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f9d9ed49-c64d-4c9d-90df-c2fc5920304d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:21.446980 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f9d9ed49-c64d-4c9d-90df-c2fc5920304d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:21.447451 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f9d9ed49-c64d-4c9d-90df-c2fc5920304d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:21.448157 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f9d9ed49-c64d-4c9d-90df-c2fc5920304d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:21.449112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f9d9ed49-c64d-4c9d-90df-c2fc5920304d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:21.449112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f9d9ed49-c64d-4c9d-90df-c2fc5920304d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:21.465307 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:21.590206 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f9d9ed49-c64d-4c9d-90df-c2fc5920304d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:21.602941 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f9d9ed49-c64d-4c9d-90df-c2fc5920304d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:21.605311 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f9d9ed49-c64d-4c9d-90df-c2fc5920304d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:21.606526 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f9d9ed49-c64d-4c9d-90df-c2fc5920304d tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.172117 Aug 05 20:50:21.607094 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 412/860] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:21 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:21.774163 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-762a1b67-1ac3-4a32-9a0f-de8d9ea5f3b0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:21.776671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-762a1b67-1ac3-4a32-9a0f-de8d9ea5f3b0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:21.785452 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-762a1b67-1ac3-4a32-9a0f-de8d9ea5f3b0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:21.786117 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-762a1b67-1ac3-4a32-9a0f-de8d9ea5f3b0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:21.786565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-762a1b67-1ac3-4a32-9a0f-de8d9ea5f3b0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:21.787271 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-762a1b67-1ac3-4a32-9a0f-de8d9ea5f3b0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:21.787925 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-762a1b67-1ac3-4a32-9a0f-de8d9ea5f3b0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:21.788349 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-762a1b67-1ac3-4a32-9a0f-de8d9ea5f3b0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:21.822281 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-762a1b67-1ac3-4a32-9a0f-de8d9ea5f3b0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052215 Aug 05 20:50:21.822852 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 449/861] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:21 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:22.414673 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f1a7a5c8-8473-484f-9496-6c02bebc92f8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:22.417156 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f1a7a5c8-8473-484f-9496-6c02bebc92f8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:22.423948 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1a7a5c8-8473-484f-9496-6c02bebc92f8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:22.424503 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1a7a5c8-8473-484f-9496-6c02bebc92f8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:22.424943 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1a7a5c8-8473-484f-9496-6c02bebc92f8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:22.425698 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1a7a5c8-8473-484f-9496-6c02bebc92f8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:22.426179 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1a7a5c8-8473-484f-9496-6c02bebc92f8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:22.426615 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1a7a5c8-8473-484f-9496-6c02bebc92f8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:22.459274 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f1a7a5c8-8473-484f-9496-6c02bebc92f8 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048723 Aug 05 20:50:22.460345 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 413/862] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:22 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:22.477535 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-70c73220-22d5-4475-b28f-f78b99c9fe6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:22.478189 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-70c73220-22d5-4475-b28f-f78b99c9fe6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:22.485263 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-70c73220-22d5-4475-b28f-f78b99c9fe6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:22.485715 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-70c73220-22d5-4475-b28f-f78b99c9fe6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:22.486149 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-70c73220-22d5-4475-b28f-f78b99c9fe6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:22.486858 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-70c73220-22d5-4475-b28f-f78b99c9fe6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:22.487300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-70c73220-22d5-4475-b28f-f78b99c9fe6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:22.487735 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-70c73220-22d5-4475-b28f-f78b99c9fe6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:22.504640 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:22.518671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-70c73220-22d5-4475-b28f-f78b99c9fe6b tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments/e0cffa84-2c20-467b-bdce-0d0b69d5eba8" status: 200 len: 194 microversion: 2.1 time: 0.048812 Aug 05 20:50:22.519254 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 450/863] 10.222.0.100 () {58 vars in 1418 bytes} [Fri Aug 5 20:50:22 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments/e0cffa84-2c20-467b-bdce-0d0b69d5eba8 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:22.630049 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e76c581f-f4bb-4c0f-8d4e-8dc6d6549d83 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:22.630753 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e76c581f-f4bb-4c0f-8d4e-8dc6d6549d83 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:22.637278 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e76c581f-f4bb-4c0f-8d4e-8dc6d6549d83 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:22.637857 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e76c581f-f4bb-4c0f-8d4e-8dc6d6549d83 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:22.638344 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e76c581f-f4bb-4c0f-8d4e-8dc6d6549d83 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:22.639268 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e76c581f-f4bb-4c0f-8d4e-8dc6d6549d83 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:22.639762 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e76c581f-f4bb-4c0f-8d4e-8dc6d6549d83 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:22.640193 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e76c581f-f4bb-4c0f-8d4e-8dc6d6549d83 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:22.791094 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-e76c581f-f4bb-4c0f-8d4e-8dc6d6549d83 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:22.801060 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-e76c581f-f4bb-4c0f-8d4e-8dc6d6549d83 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:22.803158 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-e76c581f-f4bb-4c0f-8d4e-8dc6d6549d83 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:22.804593 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e76c581f-f4bb-4c0f-8d4e-8dc6d6549d83 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.178579 Aug 05 20:50:22.805336 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 414/864] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:22 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:22.834629 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0707de27-e6c2-4a6d-985f-117487e0dfc1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:22.836949 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0707de27-e6c2-4a6d-985f-117487e0dfc1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:22.844649 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0707de27-e6c2-4a6d-985f-117487e0dfc1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:22.845228 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0707de27-e6c2-4a6d-985f-117487e0dfc1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:22.845729 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0707de27-e6c2-4a6d-985f-117487e0dfc1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:22.846503 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0707de27-e6c2-4a6d-985f-117487e0dfc1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:22.847004 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0707de27-e6c2-4a6d-985f-117487e0dfc1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:22.847634 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0707de27-e6c2-4a6d-985f-117487e0dfc1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:22.882817 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0707de27-e6c2-4a6d-985f-117487e0dfc1 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052422 Aug 05 20:50:22.883384 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 451/865] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:22 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:50:22.957863 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-dff9e17f-837b-4a75-9a42-aece4dd66e89 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:22.958370 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-dff9e17f-837b-4a75-9a42-aece4dd66e89 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:22.964731 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dff9e17f-837b-4a75-9a42-aece4dd66e89 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:22.965235 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dff9e17f-837b-4a75-9a42-aece4dd66e89 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:22.965679 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dff9e17f-837b-4a75-9a42-aece4dd66e89 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:22.966373 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dff9e17f-837b-4a75-9a42-aece4dd66e89 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:22.966968 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dff9e17f-837b-4a75-9a42-aece4dd66e89 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:22.967419 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dff9e17f-837b-4a75-9a42-aece4dd66e89 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:22.992940 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-dff9e17f-837b-4a75-9a42-aece4dd66e89 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Going to try to terminate instance {{(pid=124431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:50:23.077514 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-dff9e17f-837b-4a75-9a42-aece4dd66e89 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 204 len: 0 microversion: 2.1 time: 0.123243 Aug 05 20:50:23.078116 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 415/866] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:50:22 2022] DELETE /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:50:23.087442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ccec4e52-9311-4d30-a20d-f8986dbb0c8d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:23.088056 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ccec4e52-9311-4d30-a20d-f8986dbb0c8d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:23.094471 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccec4e52-9311-4d30-a20d-f8986dbb0c8d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:23.094966 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccec4e52-9311-4d30-a20d-f8986dbb0c8d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:23.095425 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccec4e52-9311-4d30-a20d-f8986dbb0c8d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:23.096179 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccec4e52-9311-4d30-a20d-f8986dbb0c8d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:23.096812 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccec4e52-9311-4d30-a20d-f8986dbb0c8d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:23.097475 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ccec4e52-9311-4d30-a20d-f8986dbb0c8d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:23.243126 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ccec4e52-9311-4d30-a20d-f8986dbb0c8d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:23.251546 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ccec4e52-9311-4d30-a20d-f8986dbb0c8d tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1692 microversion: 2.1 time: 0.168438 Aug 05 20:50:23.252109 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 452/867] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:23 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:23.830197 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ecb41358-1077-439f-b447-b639e1cd7ad1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:23.830904 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ecb41358-1077-439f-b447-b639e1cd7ad1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:23.837768 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ecb41358-1077-439f-b447-b639e1cd7ad1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:23.838242 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ecb41358-1077-439f-b447-b639e1cd7ad1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:23.838899 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ecb41358-1077-439f-b447-b639e1cd7ad1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:23.840308 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ecb41358-1077-439f-b447-b639e1cd7ad1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:23.840766 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ecb41358-1077-439f-b447-b639e1cd7ad1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:23.841202 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ecb41358-1077-439f-b447-b639e1cd7ad1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:23.878924 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2a6444a0-b20b-4af2-bbd2-afe6a544e337 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0245cbf-026f-416c-8fb2-43a40811a448"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:23.881463 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2a6444a0-b20b-4af2-bbd2-afe6a544e337 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:23.889180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a6444a0-b20b-4af2-bbd2-afe6a544e337 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:23.890013 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a6444a0-b20b-4af2-bbd2-afe6a544e337 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:23.890443 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a6444a0-b20b-4af2-bbd2-afe6a544e337 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:23.891144 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a6444a0-b20b-4af2-bbd2-afe6a544e337 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:23.891643 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a6444a0-b20b-4af2-bbd2-afe6a544e337 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:23.892064 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a6444a0-b20b-4af2-bbd2-afe6a544e337 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:23.983492 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ecb41358-1077-439f-b447-b639e1cd7ad1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:23.991651 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ecb41358-1077-439f-b447-b639e1cd7ad1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:23.993181 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ecb41358-1077-439f-b447-b639e1cd7ad1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:23.994369 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ecb41358-1077-439f-b447-b639e1cd7ad1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.169083 Aug 05 20:50:23.994915 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 416/868] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:23 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:24.279262 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-565966ae-a09c-4462-b419-354638d452f2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:24.279893 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-565966ae-a09c-4462-b419-354638d452f2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:24.286401 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-565966ae-a09c-4462-b419-354638d452f2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:24.286864 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-565966ae-a09c-4462-b419-354638d452f2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:24.287314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-565966ae-a09c-4462-b419-354638d452f2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:24.288035 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-565966ae-a09c-4462-b419-354638d452f2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:24.288485 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-565966ae-a09c-4462-b419-354638d452f2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:24.288904 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-565966ae-a09c-4462-b419-354638d452f2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:24.430254 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-565966ae-a09c-4462-b419-354638d452f2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:24.438372 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-565966ae-a09c-4462-b419-354638d452f2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1692 microversion: 2.1 time: 0.165289 Aug 05 20:50:24.438935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 417/869] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:24 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:24.645125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-713fd0d0-4856-467c-be77-9b188990b00c req-760e23b5-84fe-415a-b372-065e16546b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe498615-6695-4746-89be-48a9e31f6b4d", "name": "network-vif-plugged", "status": "completed", "tag": "5596f6df-3385-436f-9183-b31838466a7c"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:24.656173 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-713fd0d0-4856-467c-be77-9b188990b00c req-760e23b5-84fe-415a-b372-065e16546b9e service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:24.656665 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-713fd0d0-4856-467c-be77-9b188990b00c req-760e23b5-84fe-415a-b372-065e16546b9e service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:24.657082 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-713fd0d0-4856-467c-be77-9b188990b00c req-760e23b5-84fe-415a-b372-065e16546b9e service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:24.668814 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-713fd0d0-4856-467c-be77-9b188990b00c req-760e23b5-84fe-415a-b372-065e16546b9e service nova] Creating event network-vif-plugged:5596f6df-3385-436f-9183-b31838466a7c for instance fe498615-6695-4746-89be-48a9e31f6b4d on hv-cinder-85220 Aug 05 20:50:24.673774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-713fd0d0-4856-467c-be77-9b188990b00c req-760e23b5-84fe-415a-b372-065e16546b9e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032438 Aug 05 20:50:24.674565 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 418/870] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:25.017893 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-03e82ee6-a3e0-438b-8882-bcc69d381e1c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:25.018581 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-03e82ee6-a3e0-438b-8882-bcc69d381e1c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:25.025591 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-03e82ee6-a3e0-438b-8882-bcc69d381e1c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:25.026087 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-03e82ee6-a3e0-438b-8882-bcc69d381e1c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:25.026918 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-03e82ee6-a3e0-438b-8882-bcc69d381e1c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:25.027656 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-03e82ee6-a3e0-438b-8882-bcc69d381e1c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:25.028125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-03e82ee6-a3e0-438b-8882-bcc69d381e1c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:25.028551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-03e82ee6-a3e0-438b-8882-bcc69d381e1c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:25.172632 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-03e82ee6-a3e0-438b-8882-bcc69d381e1c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:25.184233 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-03e82ee6-a3e0-438b-8882-bcc69d381e1c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:25.185736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-03e82ee6-a3e0-438b-8882-bcc69d381e1c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:25.186901 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-03e82ee6-a3e0-438b-8882-bcc69d381e1c tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.173881 Aug 05 20:50:25.187481 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 419/871] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:25 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:25.461599 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f6b20e22-7790-44e1-9df2-4353fea55f16 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:25.462366 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f6b20e22-7790-44e1-9df2-4353fea55f16 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:25.472735 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f6b20e22-7790-44e1-9df2-4353fea55f16 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:25.473435 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f6b20e22-7790-44e1-9df2-4353fea55f16 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:25.474089 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f6b20e22-7790-44e1-9df2-4353fea55f16 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:25.475174 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f6b20e22-7790-44e1-9df2-4353fea55f16 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:25.475917 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f6b20e22-7790-44e1-9df2-4353fea55f16 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:25.476560 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f6b20e22-7790-44e1-9df2-4353fea55f16 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:25.614671 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f6b20e22-7790-44e1-9df2-4353fea55f16 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:25.622548 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f6b20e22-7790-44e1-9df2-4353fea55f16 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1692 microversion: 2.1 time: 0.165910 Aug 05 20:50:25.623122 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 420/872] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:25 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:26.211511 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4033871a-90c7-43bd-b57d-acea0f0c8cc6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:26.212283 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4033871a-90c7-43bd-b57d-acea0f0c8cc6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:26.219903 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4033871a-90c7-43bd-b57d-acea0f0c8cc6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:26.220450 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4033871a-90c7-43bd-b57d-acea0f0c8cc6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:26.220940 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4033871a-90c7-43bd-b57d-acea0f0c8cc6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:26.221716 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4033871a-90c7-43bd-b57d-acea0f0c8cc6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:26.222223 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4033871a-90c7-43bd-b57d-acea0f0c8cc6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:26.222705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4033871a-90c7-43bd-b57d-acea0f0c8cc6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:26.376175 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4033871a-90c7-43bd-b57d-acea0f0c8cc6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:26.393791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4033871a-90c7-43bd-b57d-acea0f0c8cc6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:26.395306 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4033871a-90c7-43bd-b57d-acea0f0c8cc6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:26.396519 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4033871a-90c7-43bd-b57d-acea0f0c8cc6 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.189567 Aug 05 20:50:26.397119 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 421/873] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:26 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:26.645301 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9d2bac72-d7b4-4ee7-b635-69b7821d10d6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:26.645920 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9d2bac72-d7b4-4ee7-b635-69b7821d10d6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:26.654904 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d2bac72-d7b4-4ee7-b635-69b7821d10d6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:26.655427 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d2bac72-d7b4-4ee7-b635-69b7821d10d6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:26.655897 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d2bac72-d7b4-4ee7-b635-69b7821d10d6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:26.656586 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d2bac72-d7b4-4ee7-b635-69b7821d10d6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:26.657045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d2bac72-d7b4-4ee7-b635-69b7821d10d6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:26.657465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d2bac72-d7b4-4ee7-b635-69b7821d10d6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:26.732852 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2a6444a0-b20b-4af2-bbd2-afe6a544e337 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "POST /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.857601 Aug 05 20:50:26.734664 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 453/874] 10.222.0.100 () {60 vars in 1328 bytes} [Fri Aug 5 20:50:23 2022] POST /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments => generated 194 bytes in 2860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:26.903222 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-9d2bac72-d7b4-4ee7-b635-69b7821d10d6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:26.912125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9d2bac72-d7b4-4ee7-b635-69b7821d10d6 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1692 microversion: 2.1 time: 0.271785 Aug 05 20:50:26.915415 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 422/875] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:26 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1692 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:27.429609 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-529327db-9bf1-427a-b148-baf86e2d8b79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:27.430375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-529327db-9bf1-427a-b148-baf86e2d8b79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:27.438676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-529327db-9bf1-427a-b148-baf86e2d8b79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:27.439164 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-529327db-9bf1-427a-b148-baf86e2d8b79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:27.439642 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-529327db-9bf1-427a-b148-baf86e2d8b79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:27.440335 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-529327db-9bf1-427a-b148-baf86e2d8b79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:27.440787 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-529327db-9bf1-427a-b148-baf86e2d8b79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:27.441210 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-529327db-9bf1-427a-b148-baf86e2d8b79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:27.647765 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-529327db-9bf1-427a-b148-baf86e2d8b79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:27.656647 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-529327db-9bf1-427a-b148-baf86e2d8b79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:27.658359 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-529327db-9bf1-427a-b148-baf86e2d8b79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:27.659606 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-529327db-9bf1-427a-b148-baf86e2d8b79 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.236830 Aug 05 20:50:27.660214 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 454/876] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:27 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:27.937365 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-60d8d7a7-9b06-42ef-aca8-3426821747bd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:27.938046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-60d8d7a7-9b06-42ef-aca8-3426821747bd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:27.944685 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-60d8d7a7-9b06-42ef-aca8-3426821747bd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:27.945176 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-60d8d7a7-9b06-42ef-aca8-3426821747bd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:27.945613 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-60d8d7a7-9b06-42ef-aca8-3426821747bd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:27.946317 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-60d8d7a7-9b06-42ef-aca8-3426821747bd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:27.946771 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-60d8d7a7-9b06-42ef-aca8-3426821747bd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:27.947256 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-60d8d7a7-9b06-42ef-aca8-3426821747bd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:28.054627 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-60d8d7a7-9b06-42ef-aca8-3426821747bd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:28.070867 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-60d8d7a7-9b06-42ef-aca8-3426821747bd tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1624 microversion: 2.1 time: 0.138054 Aug 05 20:50:28.071084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-e249e593-236e-4687-b8fa-c9945402d26e req-1c02ffc1-218f-427a-b2c9-a539dbb023c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34d5df9-1498-4fdd-a688-5d8bad899a6f", "name": "network-vif-deleted", "tag": "eaa0d3a0-5e0f-465f-ac62-8d0749b1809c"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:28.078554 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 423/877] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:27 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1624 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:28.094007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-e249e593-236e-4687-b8fa-c9945402d26e req-1c02ffc1-218f-427a-b2c9-a539dbb023c8 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:28.094605 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-e249e593-236e-4687-b8fa-c9945402d26e req-1c02ffc1-218f-427a-b2c9-a539dbb023c8 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:28.095054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-e249e593-236e-4687-b8fa-c9945402d26e req-1c02ffc1-218f-427a-b2c9-a539dbb023c8 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:28.109802 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-e249e593-236e-4687-b8fa-c9945402d26e req-1c02ffc1-218f-427a-b2c9-a539dbb023c8 service nova] Creating event network-vif-deleted:eaa0d3a0-5e0f-465f-ac62-8d0749b1809c for instance c34d5df9-1498-4fdd-a688-5d8bad899a6f on hv-cinder-85220 Aug 05 20:50:28.115255 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-e249e593-236e-4687-b8fa-c9945402d26e req-1c02ffc1-218f-427a-b2c9-a539dbb023c8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144155 Aug 05 20:50:28.115904 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 455/878] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:28.682428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f17a4dad-05b8-4c3f-af9f-ccda0adbe29e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:28.683130 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f17a4dad-05b8-4c3f-af9f-ccda0adbe29e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:28.689599 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f17a4dad-05b8-4c3f-af9f-ccda0adbe29e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:28.690093 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f17a4dad-05b8-4c3f-af9f-ccda0adbe29e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:28.690745 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f17a4dad-05b8-4c3f-af9f-ccda0adbe29e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:28.691636 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f17a4dad-05b8-4c3f-af9f-ccda0adbe29e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:28.692089 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f17a4dad-05b8-4c3f-af9f-ccda0adbe29e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:28.692726 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f17a4dad-05b8-4c3f-af9f-ccda0adbe29e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:28.836899 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f17a4dad-05b8-4c3f-af9f-ccda0adbe29e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:28.845327 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f17a4dad-05b8-4c3f-af9f-ccda0adbe29e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:28.846870 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f17a4dad-05b8-4c3f-af9f-ccda0adbe29e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:28.848092 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f17a4dad-05b8-4c3f-af9f-ccda0adbe29e tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1734 microversion: 2.20 time: 0.169715 Aug 05 20:50:28.848659 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 424/879] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:28 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 20:50:29.093362 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2f11a6d9-2601-4553-a9c1-871c68e64dee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:29.094098 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2f11a6d9-2601-4553-a9c1-871c68e64dee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:29.102344 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f11a6d9-2601-4553-a9c1-871c68e64dee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:29.102846 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f11a6d9-2601-4553-a9c1-871c68e64dee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:29.103283 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f11a6d9-2601-4553-a9c1-871c68e64dee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:29.104030 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f11a6d9-2601-4553-a9c1-871c68e64dee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:29.104484 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f11a6d9-2601-4553-a9c1-871c68e64dee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:29.105207 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f11a6d9-2601-4553-a9c1-871c68e64dee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:29.144159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f11a6d9-2601-4553-a9c1-871c68e64dee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:29.144655 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f11a6d9-2601-4553-a9c1-871c68e64dee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:29.145103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2f11a6d9-2601-4553-a9c1-871c68e64dee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:29.145563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-2f11a6d9-2601-4553-a9c1-871c68e64dee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lazy-loading 'fault' on Instance uuid c34d5df9-1498-4fdd-a688-5d8bad899a6f {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:50:29.194450 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2f11a6d9-2601-4553-a9c1-871c68e64dee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:29.201900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2f11a6d9-2601-4553-a9c1-871c68e64dee tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 200 len: 1338 microversion: 2.1 time: 0.113075 Aug 05 20:50:29.202485 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 456/880] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:29 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 1338 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:29.634532 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d94d04ba-725f-4d16-9ed3-636339deb5b6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:29.635512 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d94d04ba-725f-4d16-9ed3-636339deb5b6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:29.646832 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d94d04ba-725f-4d16-9ed3-636339deb5b6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:29.647710 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d94d04ba-725f-4d16-9ed3-636339deb5b6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:29.648453 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d94d04ba-725f-4d16-9ed3-636339deb5b6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:29.649587 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d94d04ba-725f-4d16-9ed3-636339deb5b6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:29.650348 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d94d04ba-725f-4d16-9ed3-636339deb5b6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:29.651067 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d94d04ba-725f-4d16-9ed3-636339deb5b6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:29.681606 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d94d04ba-725f-4d16-9ed3-636339deb5b6 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12/ips" status: 200 len: 148 microversion: 2.1 time: 0.053647 Aug 05 20:50:29.682186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 425/881] 10.222.0.100 () {58 vars in 1253 bytes} [Fri Aug 5 20:50:29 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12/ips => generated 148 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:29.871608 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4554c9a5-054c-4880-8e87-34dc2b99b838 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:29.872068 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4554c9a5-054c-4880-8e87-34dc2b99b838 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:29.878331 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4554c9a5-054c-4880-8e87-34dc2b99b838 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:29.878820 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4554c9a5-054c-4880-8e87-34dc2b99b838 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:29.879251 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4554c9a5-054c-4880-8e87-34dc2b99b838 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:29.879981 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4554c9a5-054c-4880-8e87-34dc2b99b838 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:29.880436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4554c9a5-054c-4880-8e87-34dc2b99b838 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:29.880855 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4554c9a5-054c-4880-8e87-34dc2b99b838 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:30.081931 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4554c9a5-054c-4880-8e87-34dc2b99b838 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:30.090288 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4554c9a5-054c-4880-8e87-34dc2b99b838 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:30.091844 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4554c9a5-054c-4880-8e87-34dc2b99b838 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:30.093027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4554c9a5-054c-4880-8e87-34dc2b99b838 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1721 microversion: 2.20 time: 0.226096 Aug 05 20:50:30.093633 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 457/882] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:50:29 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:50:30.228160 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8c0dd541-e4e6-48f6-85af-6c46d12be4fe tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:30.228984 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8c0dd541-e4e6-48f6-85af-6c46d12be4fe tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: c34d5df9-1498-4fdd-a688-5d8bad899a6f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:30.238944 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8c0dd541-e4e6-48f6-85af-6c46d12be4fe tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:30.239782 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8c0dd541-e4e6-48f6-85af-6c46d12be4fe tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:30.240503 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8c0dd541-e4e6-48f6-85af-6c46d12be4fe tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:30.241630 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8c0dd541-e4e6-48f6-85af-6c46d12be4fe tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:30.242375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8c0dd541-e4e6-48f6-85af-6c46d12be4fe tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:30.243069 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8c0dd541-e4e6-48f6-85af-6c46d12be4fe tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:30.258803 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-8c0dd541-e4e6-48f6-85af-6c46d12be4fe tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] HTTP exception thrown: Instance c34d5df9-1498-4fdd-a688-5d8bad899a6f could not be found. Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8c0dd541-e4e6-48f6-85af-6c46d12be4fe tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Request method failure captured: Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f HTTP/1.1 Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YF2IfsRUiZL8M7nD-mEoyeG9Rq0E23WMw4I16wHL0z90_rs5iFP7YW1fsRcWUvL-Vthi6uNykTnQoJHrrltziloH00ABGq52tY5SvfKLfx_4LqwaAb5lb3uNmD6zXxhShPue3pn6u4DtQuST4mvgSVDuYoAY6Cg1vyAFtoIP0Z3_Jc Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 80b5e8457f2d47b7a7c0d2856a513b77 Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:50:30.260792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:50:30.262465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_80b5e8457f2d47b7a7c0d2856a513b77", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:30.262465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:50:30.262465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 80b5e8457f2d47b7a7c0d2856a513b77 Aug 05 20:50:30.262465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:50:30.262465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-ServerRescueNegativeTestJSON-566068597-project Aug 05 20:50:30.262465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:50:30.262465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:50:30.262465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 2a09fb7dd7ec47e5b37d533c3701a3a2 Aug 05 20:50:30.262465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-ServerRescueNegativeTestJSON-566068597-project Aug 05 20:50:30.262465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:50:30.262465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance c34d5df9-1498-4fdd-a688-5d8bad899a6f could not be found. Aug 05 20:50:30.262465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': 'c34d5df9-1498-4fdd-a688-5d8bad899a6f'} Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34d5df9-1498-4fdd-a688-5d8bad899a6f could not be found. Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:30.263380 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34d5df9-1498-4fdd-a688-5d8bad899a6f could not be found. Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34d5df9-1498-4fdd-a688-5d8bad899a6f could not be found. Aug 05 20:50:30.264711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:30.265941 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8c0dd541-e4e6-48f6-85af-6c46d12be4fe tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Returning 404 to user: Instance c34d5df9-1498-4fdd-a688-5d8bad899a6f could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:30.265941 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8c0dd541-e4e6-48f6-85af-6c46d12be4fe tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f" status: 404 len: 111 microversion: 2.1 time: 0.040939 Aug 05 20:50:30.265941 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 426/883] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:30 2022] GET /compute/v2.1/servers/c34d5df9-1498-4fdd-a688-5d8bad899a6f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:30.271481 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-838c3253-7245-4853-ba4e-1824c41d7016 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '.version_select at 0x7f9bf006bdc0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:30.292486 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-838c3253-7245-4853-ba4e-1824c41d7016 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-86409659" status: 202 len: 0 microversion: 2.1 time: 0.024878 Aug 05 20:50:30.293025 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 458/884] 10.222.0.100 () {58 vars in 1220 bytes} [Fri Aug 5 20:50:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-86409659 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:50:31.063513 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-b354a81c-af45-4fd7-a99a-33a24daf2325 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f08a8d0e-b9ba-4e7e-bdae-2b7eff440736"}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:31.065976 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-b354a81c-af45-4fd7-a99a-33a24daf2325 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:31.072551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b354a81c-af45-4fd7-a99a-33a24daf2325 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:31.073046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b354a81c-af45-4fd7-a99a-33a24daf2325 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:31.073489 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b354a81c-af45-4fd7-a99a-33a24daf2325 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:31.074237 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b354a81c-af45-4fd7-a99a-33a24daf2325 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:31.074691 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b354a81c-af45-4fd7-a99a-33a24daf2325 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:31.075117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b354a81c-af45-4fd7-a99a-33a24daf2325 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:31.320522 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:31.332832 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-b354a81c-af45-4fd7-a99a-33a24daf2325 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "POST /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273203 Aug 05 20:50:31.333453 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 427/885] 10.222.0.100 () {60 vars in 1328 bytes} [Fri Aug 5 20:50:31 2022] POST /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:50:33.225272 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7ab1a8c6-d724-430b-87b0-53709757e460 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:33.225891 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7ab1a8c6-d724-430b-87b0-53709757e460 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:33.232993 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ab1a8c6-d724-430b-87b0-53709757e460 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:33.233478 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ab1a8c6-d724-430b-87b0-53709757e460 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:33.233912 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ab1a8c6-d724-430b-87b0-53709757e460 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:33.234598 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ab1a8c6-d724-430b-87b0-53709757e460 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:33.235047 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ab1a8c6-d724-430b-87b0-53709757e460 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:33.235532 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7ab1a8c6-d724-430b-87b0-53709757e460 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:33.261597 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7ab1a8c6-d724-430b-87b0-53709757e460 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:50:33.348139 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7ab1a8c6-d724-430b-87b0-53709757e460 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "DELETE /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 204 len: 0 microversion: 2.1 time: 0.126805 Aug 05 20:50:33.348939 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 459/886] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:50:33 2022] DELETE /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:50:33.361923 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-aafe4a32-7ef4-4333-b3f0-f0b09d64f6e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:33.362736 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-aafe4a32-7ef4-4333-b3f0-f0b09d64f6e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:33.366172 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:33.373784 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aafe4a32-7ef4-4333-b3f0-f0b09d64f6e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:33.374254 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aafe4a32-7ef4-4333-b3f0-f0b09d64f6e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:33.374697 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aafe4a32-7ef4-4333-b3f0-f0b09d64f6e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:33.375489 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aafe4a32-7ef4-4333-b3f0-f0b09d64f6e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:33.375959 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aafe4a32-7ef4-4333-b3f0-f0b09d64f6e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:33.376399 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-aafe4a32-7ef4-4333-b3f0-f0b09d64f6e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:33.518698 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-aafe4a32-7ef4-4333-b3f0-f0b09d64f6e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:33.527776 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-aafe4a32-7ef4-4333-b3f0-f0b09d64f6e2 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1513 microversion: 2.1 time: 0.173220 Aug 05 20:50:33.528350 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 428/887] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:33 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:34.549844 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6486149d-33dd-4c52-9754-227a7a46e256 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:34.550546 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6486149d-33dd-4c52-9754-227a7a46e256 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:34.557375 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6486149d-33dd-4c52-9754-227a7a46e256 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:34.557867 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6486149d-33dd-4c52-9754-227a7a46e256 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:34.558303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6486149d-33dd-4c52-9754-227a7a46e256 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:34.559038 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6486149d-33dd-4c52-9754-227a7a46e256 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:34.559523 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6486149d-33dd-4c52-9754-227a7a46e256 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:34.559959 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6486149d-33dd-4c52-9754-227a7a46e256 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:34.701392 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-6486149d-33dd-4c52-9754-227a7a46e256 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:34.713723 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6486149d-33dd-4c52-9754-227a7a46e256 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1513 microversion: 2.1 time: 0.167880 Aug 05 20:50:34.714551 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 460/888] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:34 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:35.735606 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9d812618-2560-4766-ba4e-cc38463cc587 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:35.736221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9d812618-2560-4766-ba4e-cc38463cc587 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:35.743155 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d812618-2560-4766-ba4e-cc38463cc587 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:35.743692 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d812618-2560-4766-ba4e-cc38463cc587 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:35.744133 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d812618-2560-4766-ba4e-cc38463cc587 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:35.744840 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d812618-2560-4766-ba4e-cc38463cc587 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:35.745325 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d812618-2560-4766-ba4e-cc38463cc587 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:35.745962 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9d812618-2560-4766-ba4e-cc38463cc587 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:35.886716 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-9d812618-2560-4766-ba4e-cc38463cc587 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:35.894993 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9d812618-2560-4766-ba4e-cc38463cc587 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1513 microversion: 2.1 time: 0.163365 Aug 05 20:50:35.895657 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 429/889] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:35 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:36.459178 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-673ab2b2-7270-4594-8ae0-22eb0e263ebe req-db558078-372d-4f7d-97ef-a26f937740ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424981e0-db2d-449a-a636-3bb3b031f7da", "name": "network-vif-deleted", "tag": "5c3c2d43-cbba-4420-8c65-04c62e695ae7"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:36.475342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-673ab2b2-7270-4594-8ae0-22eb0e263ebe req-db558078-372d-4f7d-97ef-a26f937740ef service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:36.476037 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-673ab2b2-7270-4594-8ae0-22eb0e263ebe req-db558078-372d-4f7d-97ef-a26f937740ef service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:36.476626 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-673ab2b2-7270-4594-8ae0-22eb0e263ebe req-db558078-372d-4f7d-97ef-a26f937740ef service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:36.490414 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-673ab2b2-7270-4594-8ae0-22eb0e263ebe req-db558078-372d-4f7d-97ef-a26f937740ef service nova] Creating event network-vif-deleted:5c3c2d43-cbba-4420-8c65-04c62e695ae7 for instance 424981e0-db2d-449a-a636-3bb3b031f7da on hv-cinder-85220 Aug 05 20:50:36.496777 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-673ab2b2-7270-4594-8ae0-22eb0e263ebe req-db558078-372d-4f7d-97ef-a26f937740ef service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042879 Aug 05 20:50:36.497374 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 461/890] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:36.517674 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7e86ab44-5626-4191-b98c-3fe155b70a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:36.520959 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-7e86ab44-5626-4191-b98c-3fe155b70a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:36.528711 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e86ab44-5626-4191-b98c-3fe155b70a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:36.529400 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e86ab44-5626-4191-b98c-3fe155b70a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:36.530068 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e86ab44-5626-4191-b98c-3fe155b70a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:36.530872 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e86ab44-5626-4191-b98c-3fe155b70a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:36.531343 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e86ab44-5626-4191-b98c-3fe155b70a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:36.531812 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7e86ab44-5626-4191-b98c-3fe155b70a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:36.563653 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-7e86ab44-5626-4191-b98c-3fe155b70a99 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051772 Aug 05 20:50:36.564232 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 430/891] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:36 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:36.720706 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ab483022-7e62-402a-bfc4-a71abd7b99c3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:36.721370 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ab483022-7e62-402a-bfc4-a71abd7b99c3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:36.728775 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab483022-7e62-402a-bfc4-a71abd7b99c3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:36.729601 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab483022-7e62-402a-bfc4-a71abd7b99c3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:36.730273 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab483022-7e62-402a-bfc4-a71abd7b99c3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:36.731224 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab483022-7e62-402a-bfc4-a71abd7b99c3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:36.731766 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab483022-7e62-402a-bfc4-a71abd7b99c3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:36.732483 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab483022-7e62-402a-bfc4-a71abd7b99c3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:36.764184 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ab483022-7e62-402a-bfc4-a71abd7b99c3 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments/e0cffa84-2c20-467b-bdce-0d0b69d5eba8" status: 200 len: 194 microversion: 2.1 time: 0.049064 Aug 05 20:50:36.765276 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 462/892] 10.222.0.100 () {58 vars in 1418 bytes} [Fri Aug 5 20:50:36 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments/e0cffa84-2c20-467b-bdce-0d0b69d5eba8 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:36.775541 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4ac9a669-eb81-40f9-a6c9-d9ecc900199c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:36.776458 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4ac9a669-eb81-40f9-a6c9-d9ecc900199c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:36.783265 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ac9a669-eb81-40f9-a6c9-d9ecc900199c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:36.783898 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ac9a669-eb81-40f9-a6c9-d9ecc900199c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:36.784414 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ac9a669-eb81-40f9-a6c9-d9ecc900199c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:36.785266 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ac9a669-eb81-40f9-a6c9-d9ecc900199c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:36.785786 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ac9a669-eb81-40f9-a6c9-d9ecc900199c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:36.786282 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4ac9a669-eb81-40f9-a6c9-d9ecc900199c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:36.878460 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-4ac9a669-eb81-40f9-a6c9-d9ecc900199c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lazy-loading 'services' on Instance uuid 0b095014-137c-4100-a4a2-69023e2cd17d {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:50:36.917748 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-839b2b65-143c-4fc7-80e4-5e4ee9f92b15 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:36.918365 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-839b2b65-143c-4fc7-80e4-5e4ee9f92b15 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:36.925328 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-839b2b65-143c-4fc7-80e4-5e4ee9f92b15 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:36.925821 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-839b2b65-143c-4fc7-80e4-5e4ee9f92b15 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:36.926488 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-839b2b65-143c-4fc7-80e4-5e4ee9f92b15 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:36.927215 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-839b2b65-143c-4fc7-80e4-5e4ee9f92b15 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:36.927700 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-839b2b65-143c-4fc7-80e4-5e4ee9f92b15 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:36.928176 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-839b2b65-143c-4fc7-80e4-5e4ee9f92b15 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:36.963229 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-839b2b65-143c-4fc7-80e4-5e4ee9f92b15 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:36.963735 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-839b2b65-143c-4fc7-80e4-5e4ee9f92b15 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:36.964379 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-839b2b65-143c-4fc7-80e4-5e4ee9f92b15 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:36.964999 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-839b2b65-143c-4fc7-80e4-5e4ee9f92b15 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lazy-loading 'fault' on Instance uuid 424981e0-db2d-449a-a636-3bb3b031f7da {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:50:36.976474 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4ac9a669-eb81-40f9-a6c9-d9ecc900199c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments/e0cffa84-2c20-467b-bdce-0d0b69d5eba8" status: 202 len: 0 microversion: 2.1 time: 0.204823 Aug 05 20:50:36.977063 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 431/893] 10.222.0.100 () {58 vars in 1421 bytes} [Fri Aug 5 20:50:36 2022] DELETE /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments/e0cffa84-2c20-467b-bdce-0d0b69d5eba8 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:50:37.015023 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-839b2b65-143c-4fc7-80e4-5e4ee9f92b15 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:37.022544 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-839b2b65-143c-4fc7-80e4-5e4ee9f92b15 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 200 len: 1316 microversion: 2.1 time: 0.108856 Aug 05 20:50:37.023225 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 463/894] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:36 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 1316 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:50:38.048805 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7f18a4fe-5e72-4062-8638-d1da663bb207 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:38.049508 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-7f18a4fe-5e72-4062-8638-d1da663bb207 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 424981e0-db2d-449a-a636-3bb3b031f7da] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:38.056349 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7f18a4fe-5e72-4062-8638-d1da663bb207 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:38.056850 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7f18a4fe-5e72-4062-8638-d1da663bb207 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:38.057281 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7f18a4fe-5e72-4062-8638-d1da663bb207 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:38.057990 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7f18a4fe-5e72-4062-8638-d1da663bb207 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:38.058440 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7f18a4fe-5e72-4062-8638-d1da663bb207 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:38.058867 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7f18a4fe-5e72-4062-8638-d1da663bb207 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:38.073608 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-7f18a4fe-5e72-4062-8638-d1da663bb207 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] HTTP exception thrown: Instance 424981e0-db2d-449a-a636-3bb3b031f7da could not be found. Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7f18a4fe-5e72-4062-8638-d1da663bb207 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Request method failure captured: Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da HTTP/1.1 Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YF2IfsRUiZL8M7nD-mEoyeG9Rq0E23WMw4I16wHL0z90_rs5iFP7YW1fsRcWUvL-Vthi6uNykTnQoJHrrltziloH00ABGq52tY5SvfKLfx_4LqwaAb5lb3uNmD6zXxhShPue3pn6u4DtQuST4mvgSVDuYoAY6Cg1vyAFtoIP0Z3_Jc Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 80b5e8457f2d47b7a7c0d2856a513b77 Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:50:38.075295 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:50:38.077791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_80b5e8457f2d47b7a7c0d2856a513b77", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:38.077791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:50:38.077791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 80b5e8457f2d47b7a7c0d2856a513b77 Aug 05 20:50:38.077791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:50:38.077791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-ServerRescueNegativeTestJSON-566068597-project Aug 05 20:50:38.077791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:50:38.077791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:50:38.077791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 2a09fb7dd7ec47e5b37d533c3701a3a2 Aug 05 20:50:38.077791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-ServerRescueNegativeTestJSON-566068597-project Aug 05 20:50:38.077791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:50:38.077791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 424981e0-db2d-449a-a636-3bb3b031f7da could not be found. Aug 05 20:50:38.077791 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '424981e0-db2d-449a-a636-3bb3b031f7da'} Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 424981e0-db2d-449a-a636-3bb3b031f7da could not be found. Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:38.078509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 424981e0-db2d-449a-a636-3bb3b031f7da could not be found. Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 424981e0-db2d-449a-a636-3bb3b031f7da could not be found. Aug 05 20:50:38.079774 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:38.080852 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7f18a4fe-5e72-4062-8638-d1da663bb207 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Returning 404 to user: Instance 424981e0-db2d-449a-a636-3bb3b031f7da could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:38.080852 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-7f18a4fe-5e72-4062-8638-d1da663bb207 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da" status: 404 len: 111 microversion: 2.1 time: 0.034749 Aug 05 20:50:38.080852 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 432/895] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:38 2022] GET /compute/v2.1/servers/424981e0-db2d-449a-a636-3bb3b031f7da => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:38.085940 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9e9c1222-3c61-49fc-8f01-b89e7a2aa938 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:38.087039 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9e9c1222-3c61-49fc-8f01-b89e7a2aa938 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:38.094651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e9c1222-3c61-49fc-8f01-b89e7a2aa938 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:38.095389 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e9c1222-3c61-49fc-8f01-b89e7a2aa938 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:38.095861 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e9c1222-3c61-49fc-8f01-b89e7a2aa938 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:38.096566 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e9c1222-3c61-49fc-8f01-b89e7a2aa938 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:38.097021 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e9c1222-3c61-49fc-8f01-b89e7a2aa938 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:38.097444 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9e9c1222-3c61-49fc-8f01-b89e7a2aa938 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:38.123834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9e9c1222-3c61-49fc-8f01-b89e7a2aa938 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:50:38.160163 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:38.207810 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9e9c1222-3c61-49fc-8f01-b89e7a2aa938 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "DELETE /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 204 len: 0 microversion: 2.1 time: 0.125320 Aug 05 20:50:38.208406 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 464/896] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:50:38 2022] DELETE /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:50:38.217048 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9ba0e8cf-8660-4d3e-82e8-29fbd4a17e5c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:38.217767 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9ba0e8cf-8660-4d3e-82e8-29fbd4a17e5c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:38.224209 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9ba0e8cf-8660-4d3e-82e8-29fbd4a17e5c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:38.224773 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9ba0e8cf-8660-4d3e-82e8-29fbd4a17e5c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:38.225219 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9ba0e8cf-8660-4d3e-82e8-29fbd4a17e5c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:38.225920 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9ba0e8cf-8660-4d3e-82e8-29fbd4a17e5c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:38.226376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9ba0e8cf-8660-4d3e-82e8-29fbd4a17e5c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:38.226814 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9ba0e8cf-8660-4d3e-82e8-29fbd4a17e5c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:38.371395 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-9ba0e8cf-8660-4d3e-82e8-29fbd4a17e5c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:38.379496 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9ba0e8cf-8660-4d3e-82e8-29fbd4a17e5c tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.166643 Aug 05 20:50:38.380063 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 433/897] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:38 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:38.591085 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6847ebc3-c906-4ea7-83a7-73fa247d14ae tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:38.592165 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6847ebc3-c906-4ea7-83a7-73fa247d14ae tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:38.594079 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:38.599543 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6847ebc3-c906-4ea7-83a7-73fa247d14ae tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:38.600023 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6847ebc3-c906-4ea7-83a7-73fa247d14ae tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:38.600460 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6847ebc3-c906-4ea7-83a7-73fa247d14ae tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:38.601145 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6847ebc3-c906-4ea7-83a7-73fa247d14ae tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:38.601599 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6847ebc3-c906-4ea7-83a7-73fa247d14ae tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:38.602019 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6847ebc3-c906-4ea7-83a7-73fa247d14ae tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:38.628476 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6847ebc3-c906-4ea7-83a7-73fa247d14ae tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:50:38.709484 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6847ebc3-c906-4ea7-83a7-73fa247d14ae tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "DELETE /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 204 len: 0 microversion: 2.1 time: 0.121777 Aug 05 20:50:38.709484 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 465/898] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:50:38 2022] DELETE /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:50:38.719759 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0e2c1c04-fa1f-4991-afa4-17fcb62d1de6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:38.720383 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0e2c1c04-fa1f-4991-afa4-17fcb62d1de6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:38.726702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0e2c1c04-fa1f-4991-afa4-17fcb62d1de6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:38.727196 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0e2c1c04-fa1f-4991-afa4-17fcb62d1de6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:38.727670 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0e2c1c04-fa1f-4991-afa4-17fcb62d1de6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:38.728369 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0e2c1c04-fa1f-4991-afa4-17fcb62d1de6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:38.728950 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0e2c1c04-fa1f-4991-afa4-17fcb62d1de6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:38.729383 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0e2c1c04-fa1f-4991-afa4-17fcb62d1de6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:38.870722 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0e2c1c04-fa1f-4991-afa4-17fcb62d1de6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:38.882721 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0e2c1c04-fa1f-4991-afa4-17fcb62d1de6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1581 microversion: 2.1 time: 0.167674 Aug 05 20:50:38.883565 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 434/899] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:38 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1581 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:39.402686 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a0aeb101-bfd6-4b8a-95d9-3682cfe0b8ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:39.403263 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a0aeb101-bfd6-4b8a-95d9-3682cfe0b8ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:39.410570 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0aeb101-bfd6-4b8a-95d9-3682cfe0b8ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:39.411041 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0aeb101-bfd6-4b8a-95d9-3682cfe0b8ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:39.411512 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0aeb101-bfd6-4b8a-95d9-3682cfe0b8ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:39.412171 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0aeb101-bfd6-4b8a-95d9-3682cfe0b8ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:39.412657 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0aeb101-bfd6-4b8a-95d9-3682cfe0b8ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:39.413078 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a0aeb101-bfd6-4b8a-95d9-3682cfe0b8ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:39.558967 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a0aeb101-bfd6-4b8a-95d9-3682cfe0b8ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:39.567880 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a0aeb101-bfd6-4b8a-95d9-3682cfe0b8ac tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.170192 Aug 05 20:50:39.568446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 466/900] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:39 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:39.907922 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f2e7c62d-1ef6-477e-857d-8ff00667f4a2 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:39.908536 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f2e7c62d-1ef6-477e-857d-8ff00667f4a2 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:39.915600 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f2e7c62d-1ef6-477e-857d-8ff00667f4a2 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:39.916091 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f2e7c62d-1ef6-477e-857d-8ff00667f4a2 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:39.916527 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f2e7c62d-1ef6-477e-857d-8ff00667f4a2 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:39.917220 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f2e7c62d-1ef6-477e-857d-8ff00667f4a2 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:39.917663 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f2e7c62d-1ef6-477e-857d-8ff00667f4a2 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:39.918088 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f2e7c62d-1ef6-477e-857d-8ff00667f4a2 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:40.060691 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f2e7c62d-1ef6-477e-857d-8ff00667f4a2 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:40.069281 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f2e7c62d-1ef6-477e-857d-8ff00667f4a2 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1581 microversion: 2.1 time: 0.166115 Aug 05 20:50:40.069853 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 435/901] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:39 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1581 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:40.588771 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1017bacd-0a01-436a-80d2-3a4d3728da91 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:40.589379 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1017bacd-0a01-436a-80d2-3a4d3728da91 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:40.596925 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1017bacd-0a01-436a-80d2-3a4d3728da91 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:40.597414 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1017bacd-0a01-436a-80d2-3a4d3728da91 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:40.597846 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1017bacd-0a01-436a-80d2-3a4d3728da91 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:40.598538 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1017bacd-0a01-436a-80d2-3a4d3728da91 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:40.598992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1017bacd-0a01-436a-80d2-3a4d3728da91 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:40.599440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1017bacd-0a01-436a-80d2-3a4d3728da91 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:40.750611 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1017bacd-0a01-436a-80d2-3a4d3728da91 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:40.758998 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1017bacd-0a01-436a-80d2-3a4d3728da91 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.174278 Aug 05 20:50:40.759575 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 467/902] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:40 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:41.090765 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-5ce2570e-bf05-41a6-8dc4-10e1d1a01ac4 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:41.092069 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-5ce2570e-bf05-41a6-8dc4-10e1d1a01ac4 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:41.101938 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ce2570e-bf05-41a6-8dc4-10e1d1a01ac4 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:41.102613 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ce2570e-bf05-41a6-8dc4-10e1d1a01ac4 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:41.103202 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ce2570e-bf05-41a6-8dc4-10e1d1a01ac4 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:41.104248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ce2570e-bf05-41a6-8dc4-10e1d1a01ac4 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:41.104872 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ce2570e-bf05-41a6-8dc4-10e1d1a01ac4 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:41.105454 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5ce2570e-bf05-41a6-8dc4-10e1d1a01ac4 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:41.256293 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-5ce2570e-bf05-41a6-8dc4-10e1d1a01ac4 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:41.266990 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-5ce2570e-bf05-41a6-8dc4-10e1d1a01ac4 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1581 microversion: 2.1 time: 0.180288 Aug 05 20:50:41.267598 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 436/903] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:41 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1581 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:41.786395 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b468dff2-6b31-41f2-8338-b3e802052506 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:41.787502 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b468dff2-6b31-41f2-8338-b3e802052506 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:41.797057 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b468dff2-6b31-41f2-8338-b3e802052506 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:41.797550 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b468dff2-6b31-41f2-8338-b3e802052506 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:41.797995 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b468dff2-6b31-41f2-8338-b3e802052506 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:41.798704 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b468dff2-6b31-41f2-8338-b3e802052506 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:41.799163 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b468dff2-6b31-41f2-8338-b3e802052506 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:41.799626 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b468dff2-6b31-41f2-8338-b3e802052506 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:41.943150 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b468dff2-6b31-41f2-8338-b3e802052506 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:41.951439 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b468dff2-6b31-41f2-8338-b3e802052506 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.172463 Aug 05 20:50:41.952017 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 468/904] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:41 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:42.293583 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-13ffc20e-7741-4306-beef-b1f70c93d60c tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:42.294738 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-13ffc20e-7741-4306-beef-b1f70c93d60c tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:42.306094 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-13ffc20e-7741-4306-beef-b1f70c93d60c tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:42.306911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-13ffc20e-7741-4306-beef-b1f70c93d60c tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:42.307738 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-13ffc20e-7741-4306-beef-b1f70c93d60c tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:42.308919 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-13ffc20e-7741-4306-beef-b1f70c93d60c tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:42.309689 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-13ffc20e-7741-4306-beef-b1f70c93d60c tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:42.310429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-13ffc20e-7741-4306-beef-b1f70c93d60c tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:42.444690 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-13ffc20e-7741-4306-beef-b1f70c93d60c tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:42.457417 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-13ffc20e-7741-4306-beef-b1f70c93d60c tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1581 microversion: 2.1 time: 0.170470 Aug 05 20:50:42.458244 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 437/905] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:42 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1581 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:43.082603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0873a5a4-1160-490a-9c0f-607d0f55261a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:43.083186 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0873a5a4-1160-490a-9c0f-607d0f55261a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:43.089426 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0873a5a4-1160-490a-9c0f-607d0f55261a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:43.089916 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0873a5a4-1160-490a-9c0f-607d0f55261a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:43.090342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0873a5a4-1160-490a-9c0f-607d0f55261a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:43.091034 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0873a5a4-1160-490a-9c0f-607d0f55261a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:43.091512 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0873a5a4-1160-490a-9c0f-607d0f55261a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:43.092314 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0873a5a4-1160-490a-9c0f-607d0f55261a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:43.233441 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-0873a5a4-1160-490a-9c0f-607d0f55261a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:43.241615 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0873a5a4-1160-490a-9c0f-607d0f55261a tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1526 microversion: 2.1 time: 0.273011 Aug 05 20:50:43.242152 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 469/906] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:42 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1526 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:43.480337 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-5734931e-6c73-4aea-b3d3-dca65e85cb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:43.480984 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-5734931e-6c73-4aea-b3d3-dca65e85cb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:43.487851 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5734931e-6c73-4aea-b3d3-dca65e85cb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:43.488340 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5734931e-6c73-4aea-b3d3-dca65e85cb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:43.488838 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5734931e-6c73-4aea-b3d3-dca65e85cb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:43.489563 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5734931e-6c73-4aea-b3d3-dca65e85cb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:43.490013 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5734931e-6c73-4aea-b3d3-dca65e85cb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:43.490434 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5734931e-6c73-4aea-b3d3-dca65e85cb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:43.711513 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-5734931e-6c73-4aea-b3d3-dca65e85cb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:43.719526 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-5734931e-6c73-4aea-b3d3-dca65e85cb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1581 microversion: 2.1 time: 0.243264 Aug 05 20:50:43.720111 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 438/907] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:43 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1581 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:43.890565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-769cbba8-6e93-4d22-90c5-b9a6b82b9b66 req-d6056252-e000-4329-bc9f-8ef54a351b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "601febf0-78f3-4519-b08f-382dad6f8839", "name": "network-vif-deleted", "tag": "ff52c57c-9320-4ee9-b916-9dde175b7580"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:43.902207 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-769cbba8-6e93-4d22-90c5-b9a6b82b9b66 req-d6056252-e000-4329-bc9f-8ef54a351b7a service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:43.902679 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-769cbba8-6e93-4d22-90c5-b9a6b82b9b66 req-d6056252-e000-4329-bc9f-8ef54a351b7a service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:43.903098 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-769cbba8-6e93-4d22-90c5-b9a6b82b9b66 req-d6056252-e000-4329-bc9f-8ef54a351b7a service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:43.917008 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-769cbba8-6e93-4d22-90c5-b9a6b82b9b66 req-d6056252-e000-4329-bc9f-8ef54a351b7a service nova] Creating event network-vif-deleted:ff52c57c-9320-4ee9-b916-9dde175b7580 for instance 601febf0-78f3-4519-b08f-382dad6f8839 on hv-cinder-85220 Aug 05 20:50:43.922335 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-769cbba8-6e93-4d22-90c5-b9a6b82b9b66 req-d6056252-e000-4329-bc9f-8ef54a351b7a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035551 Aug 05 20:50:43.923203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 470/908] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:44.262213 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-10b73d96-95cc-4cf9-895e-c6a08d7636bc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:44.263215 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-10b73d96-95cc-4cf9-895e-c6a08d7636bc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:44.270093 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10b73d96-95cc-4cf9-895e-c6a08d7636bc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:44.270826 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10b73d96-95cc-4cf9-895e-c6a08d7636bc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:44.271476 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10b73d96-95cc-4cf9-895e-c6a08d7636bc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:44.272344 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10b73d96-95cc-4cf9-895e-c6a08d7636bc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:44.272948 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10b73d96-95cc-4cf9-895e-c6a08d7636bc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:44.273525 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10b73d96-95cc-4cf9-895e-c6a08d7636bc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:44.350254 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10b73d96-95cc-4cf9-895e-c6a08d7636bc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:44.350254 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10b73d96-95cc-4cf9-895e-c6a08d7636bc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:44.350254 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-10b73d96-95cc-4cf9-895e-c6a08d7636bc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:44.350254 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-10b73d96-95cc-4cf9-895e-c6a08d7636bc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lazy-loading 'fault' on Instance uuid 601febf0-78f3-4519-b08f-382dad6f8839 {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:50:44.366021 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-95bc6284-a2f4-4748-bc3d-71abbe32602e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:44.366581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-95bc6284-a2f4-4748-bc3d-71abbe32602e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:44.373059 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95bc6284-a2f4-4748-bc3d-71abbe32602e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:44.373665 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95bc6284-a2f4-4748-bc3d-71abbe32602e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:44.374104 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95bc6284-a2f4-4748-bc3d-71abbe32602e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:44.374999 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95bc6284-a2f4-4748-bc3d-71abbe32602e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:44.375727 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95bc6284-a2f4-4748-bc3d-71abbe32602e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:44.376185 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-95bc6284-a2f4-4748-bc3d-71abbe32602e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:44.423025 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-10b73d96-95cc-4cf9-895e-c6a08d7636bc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a09fb7dd7ec47e5b37d533c3701a3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80b5e8457f2d47b7a7c0d2856a513b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:44.431168 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-10b73d96-95cc-4cf9-895e-c6a08d7636bc tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 200 len: 1316 microversion: 2.1 time: 0.172787 Aug 05 20:50:44.431752 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 439/909] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:44 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:44.469258 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-95bc6284-a2f4-4748-bc3d-71abbe32602e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lazy-loading 'services' on Instance uuid 6304f059-f069-47d9-808f-7546856e6a12 {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:50:44.558355 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-95bc6284-a2f4-4748-bc3d-71abbe32602e tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12/os-volume_attachments/f08a8d0e-b9ba-4e7e-bdae-2b7eff440736" status: 202 len: 0 microversion: 2.1 time: 0.197013 Aug 05 20:50:44.558962 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 471/910] 10.222.0.100 () {58 vars in 1421 bytes} [Fri Aug 5 20:50:44 2022] DELETE /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12/os-volume_attachments/f08a8d0e-b9ba-4e7e-bdae-2b7eff440736 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:50:44.567636 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-6f4ba484-deb4-4a4a-856e-2a2406e02ebd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:44.569899 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-6f4ba484-deb4-4a4a-856e-2a2406e02ebd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:44.576829 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6f4ba484-deb4-4a4a-856e-2a2406e02ebd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:44.577325 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6f4ba484-deb4-4a4a-856e-2a2406e02ebd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:44.577833 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6f4ba484-deb4-4a4a-856e-2a2406e02ebd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:44.578544 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6f4ba484-deb4-4a4a-856e-2a2406e02ebd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:44.579002 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6f4ba484-deb4-4a4a-856e-2a2406e02ebd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:44.579456 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6f4ba484-deb4-4a4a-856e-2a2406e02ebd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:44.613047 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-6f4ba484-deb4-4a4a-856e-2a2406e02ebd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049376 Aug 05 20:50:44.614568 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 440/911] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:44 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:44.741834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-448a60b1-1141-4e79-a5d3-4f1ecdf6a1dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:44.742541 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-448a60b1-1141-4e79-a5d3-4f1ecdf6a1dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:44.749222 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-448a60b1-1141-4e79-a5d3-4f1ecdf6a1dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:44.749686 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-448a60b1-1141-4e79-a5d3-4f1ecdf6a1dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:44.750175 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-448a60b1-1141-4e79-a5d3-4f1ecdf6a1dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:44.750869 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-448a60b1-1141-4e79-a5d3-4f1ecdf6a1dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:44.751288 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-448a60b1-1141-4e79-a5d3-4f1ecdf6a1dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:44.751767 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-448a60b1-1141-4e79-a5d3-4f1ecdf6a1dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:44.958966 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-448a60b1-1141-4e79-a5d3-4f1ecdf6a1dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:44.970817 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-448a60b1-1141-4e79-a5d3-4f1ecdf6a1dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1581 microversion: 2.1 time: 0.232436 Aug 05 20:50:44.986056 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 472/912] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:44 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1581 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:45.452798 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e152dffd-e676-4da5-ba3e-349a3ff5e7f0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:45.457279 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e152dffd-e676-4da5-ba3e-349a3ff5e7f0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] [instance: 601febf0-78f3-4519-b08f-382dad6f8839] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:45.463874 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e152dffd-e676-4da5-ba3e-349a3ff5e7f0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:45.464441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e152dffd-e676-4da5-ba3e-349a3ff5e7f0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:45.465120 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e152dffd-e676-4da5-ba3e-349a3ff5e7f0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:45.465934 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e152dffd-e676-4da5-ba3e-349a3ff5e7f0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:45.466458 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e152dffd-e676-4da5-ba3e-349a3ff5e7f0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:45.466959 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e152dffd-e676-4da5-ba3e-349a3ff5e7f0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:45.481012 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-e152dffd-e676-4da5-ba3e-349a3ff5e7f0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] HTTP exception thrown: Instance 601febf0-78f3-4519-b08f-382dad6f8839 could not be found. Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e152dffd-e676-4da5-ba3e-349a3ff5e7f0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Request method failure captured: Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 HTTP/1.1 Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YF2IfsRUiZL8M7nD-mEoyeG9Rq0E23WMw4I16wHL0z90_rs5iFP7YW1fsRcWUvL-Vthi6uNykTnQoJHrrltziloH00ABGq52tY5SvfKLfx_4LqwaAb5lb3uNmD6zXxhShPue3pn6u4DtQuST4mvgSVDuYoAY6Cg1vyAFtoIP0Z3_Jc Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 80b5e8457f2d47b7a7c0d2856a513b77 Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:50:45.482696 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:50:45.484723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/80b5e8457f2d47b7a7c0d2856a513b77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_80b5e8457f2d47b7a7c0d2856a513b77", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:45.484723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:50:45.484723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 80b5e8457f2d47b7a7c0d2856a513b77 Aug 05 20:50:45.484723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-566068597 Aug 05 20:50:45.484723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-ServerRescueNegativeTestJSON-566068597-project Aug 05 20:50:45.484723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:50:45.484723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:50:45.484723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 2a09fb7dd7ec47e5b37d533c3701a3a2 Aug 05 20:50:45.484723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-ServerRescueNegativeTestJSON-566068597-project Aug 05 20:50:45.484723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:50:45.484723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 601febf0-78f3-4519-b08f-382dad6f8839 could not be found. Aug 05 20:50:45.484723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '601febf0-78f3-4519-b08f-382dad6f8839'} Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 601febf0-78f3-4519-b08f-382dad6f8839 could not be found. Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:45.485961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 601febf0-78f3-4519-b08f-382dad6f8839 could not be found. Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 601febf0-78f3-4519-b08f-382dad6f8839 could not be found. Aug 05 20:50:45.487208 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:45.489008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e152dffd-e676-4da5-ba3e-349a3ff5e7f0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] Returning 404 to user: Instance 601febf0-78f3-4519-b08f-382dad6f8839 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:45.489008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e152dffd-e676-4da5-ba3e-349a3ff5e7f0 tempest-ServerRescueNegativeTestJSON-566068597 tempest-ServerRescueNegativeTestJSON-566068597-project] 10.222.0.100 "GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839" status: 404 len: 111 microversion: 2.1 time: 0.035784 Aug 05 20:50:45.489008 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 441/913] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:45 2022] GET /compute/v2.1/servers/601febf0-78f3-4519-b08f-382dad6f8839 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:45.590648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5a51fb1f-7c76-422c-9c55-2952da86ea0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:45.592970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5a51fb1f-7c76-422c-9c55-2952da86ea0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:45.605673 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a51fb1f-7c76-422c-9c55-2952da86ea0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:45.607567 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a51fb1f-7c76-422c-9c55-2952da86ea0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:45.608382 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a51fb1f-7c76-422c-9c55-2952da86ea0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:45.609716 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a51fb1f-7c76-422c-9c55-2952da86ea0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:45.611422 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a51fb1f-7c76-422c-9c55-2952da86ea0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:45.612390 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5a51fb1f-7c76-422c-9c55-2952da86ea0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:45.629718 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a8f24587-e954-4442-92f3-e7ca43eb6544 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:45.632238 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a8f24587-e954-4442-92f3-e7ca43eb6544 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:45.652532 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a8f24587-e954-4442-92f3-e7ca43eb6544 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:45.653457 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a8f24587-e954-4442-92f3-e7ca43eb6544 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:45.654063 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a8f24587-e954-4442-92f3-e7ca43eb6544 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:45.654943 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a8f24587-e954-4442-92f3-e7ca43eb6544 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:45.655588 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a8f24587-e954-4442-92f3-e7ca43eb6544 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:45.656228 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a8f24587-e954-4442-92f3-e7ca43eb6544 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:45.662418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5a51fb1f-7c76-422c-9c55-2952da86ea0e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments/a0245cbf-026f-416c-8fb2-43a40811a448" status: 200 len: 194 microversion: 2.1 time: 0.077960 Aug 05 20:50:45.668821 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 473/914] 10.222.0.100 () {58 vars in 1418 bytes} [Fri Aug 5 20:50:45 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments/a0245cbf-026f-416c-8fb2-43a40811a448 => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:45.676453 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ce47887e-ca77-4dae-9657-4d4676ae42c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:45.677041 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ce47887e-ca77-4dae-9657-4d4676ae42c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:45.684039 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce47887e-ca77-4dae-9657-4d4676ae42c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:45.685493 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce47887e-ca77-4dae-9657-4d4676ae42c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:45.686152 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce47887e-ca77-4dae-9657-4d4676ae42c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:45.687294 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce47887e-ca77-4dae-9657-4d4676ae42c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:45.688306 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce47887e-ca77-4dae-9657-4d4676ae42c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:45.688956 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ce47887e-ca77-4dae-9657-4d4676ae42c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:45.706654 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a8f24587-e954-4442-92f3-e7ca43eb6544 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080661 Aug 05 20:50:45.707386 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 442/915] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:45 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:45.943148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-ce47887e-ca77-4dae-9657-4d4676ae42c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lazy-loading 'services' on Instance uuid 0b095014-137c-4100-a4a2-69023e2cd17d {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:50:45.993510 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ef4cd3d8-ff47-4ad9-951b-efa8cde1549b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:45.994860 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ef4cd3d8-ff47-4ad9-951b-efa8cde1549b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:46.004670 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef4cd3d8-ff47-4ad9-951b-efa8cde1549b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:46.005353 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef4cd3d8-ff47-4ad9-951b-efa8cde1549b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:46.005853 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef4cd3d8-ff47-4ad9-951b-efa8cde1549b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:46.006631 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef4cd3d8-ff47-4ad9-951b-efa8cde1549b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:46.007159 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef4cd3d8-ff47-4ad9-951b-efa8cde1549b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:46.007672 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef4cd3d8-ff47-4ad9-951b-efa8cde1549b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:46.047766 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ce47887e-ca77-4dae-9657-4d4676ae42c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments/a0245cbf-026f-416c-8fb2-43a40811a448" status: 202 len: 0 microversion: 2.1 time: 0.375903 Aug 05 20:50:46.048371 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 474/916] 10.222.0.100 () {58 vars in 1421 bytes} [Fri Aug 5 20:50:45 2022] DELETE /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments/a0245cbf-026f-416c-8fb2-43a40811a448 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:50:46.066054 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef4cd3d8-ff47-4ad9-951b-efa8cde1549b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:46.066912 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef4cd3d8-ff47-4ad9-951b-efa8cde1549b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:46.067681 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ef4cd3d8-ff47-4ad9-951b-efa8cde1549b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:46.068362 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-ef4cd3d8-ff47-4ad9-951b-efa8cde1549b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lazy-loading 'fault' on Instance uuid 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:50:46.192452 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-b9424aa4-e61e-47a8-80c5-e3233b7789cf req-1a3874c5-17c7-43f9-95ce-9b520b1cb312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c7ca7c-10a8-4b62-a82e-01b05bd4cf19", "name": "network-vif-deleted", "tag": "a2fcfeb9-5c68-48c4-8cf9-887f89995b6e"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:46.204301 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-b9424aa4-e61e-47a8-80c5-e3233b7789cf req-1a3874c5-17c7-43f9-95ce-9b520b1cb312 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:46.204571 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-b9424aa4-e61e-47a8-80c5-e3233b7789cf req-1a3874c5-17c7-43f9-95ce-9b520b1cb312 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:46.205325 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-b9424aa4-e61e-47a8-80c5-e3233b7789cf req-1a3874c5-17c7-43f9-95ce-9b520b1cb312 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:46.218028 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-b9424aa4-e61e-47a8-80c5-e3233b7789cf req-1a3874c5-17c7-43f9-95ce-9b520b1cb312 service nova] Creating event network-vif-deleted:a2fcfeb9-5c68-48c4-8cf9-887f89995b6e for instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 on hv-cinder-85220 Aug 05 20:50:46.223281 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-b9424aa4-e61e-47a8-80c5-e3233b7789cf req-1a3874c5-17c7-43f9-95ce-9b520b1cb312 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035766 Aug 05 20:50:46.224315 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 475/917] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:46.228059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ef4cd3d8-ff47-4ad9-951b-efa8cde1549b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:46.236350 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ef4cd3d8-ff47-4ad9-951b-efa8cde1549b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 200 len: 1233 microversion: 2.1 time: 0.247454 Aug 05 20:50:46.236941 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 443/918] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:45 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 1233 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:50:46.720776 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-266984a7-0de2-4c93-988c-46858ba253cd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:46.723116 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-266984a7-0de2-4c93-988c-46858ba253cd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:46.730142 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-266984a7-0de2-4c93-988c-46858ba253cd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:46.730142 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-266984a7-0de2-4c93-988c-46858ba253cd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:46.730579 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-266984a7-0de2-4c93-988c-46858ba253cd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:46.731395 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-266984a7-0de2-4c93-988c-46858ba253cd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:46.731840 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-266984a7-0de2-4c93-988c-46858ba253cd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:46.732264 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-266984a7-0de2-4c93-988c-46858ba253cd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:46.770905 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-266984a7-0de2-4c93-988c-46858ba253cd tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055163 Aug 05 20:50:46.771589 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 476/919] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:46 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:50:46.833936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-bf8d7e88-778b-438e-89ee-1b9604a49b9d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:46.834547 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-bf8d7e88-778b-438e-89ee-1b9604a49b9d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:46.841117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bf8d7e88-778b-438e-89ee-1b9604a49b9d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:46.841609 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bf8d7e88-778b-438e-89ee-1b9604a49b9d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:46.842123 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bf8d7e88-778b-438e-89ee-1b9604a49b9d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:46.842728 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bf8d7e88-778b-438e-89ee-1b9604a49b9d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:46.843257 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bf8d7e88-778b-438e-89ee-1b9604a49b9d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:46.843876 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-bf8d7e88-778b-438e-89ee-1b9604a49b9d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:46.860094 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:46.872378 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-bf8d7e88-778b-438e-89ee-1b9604a49b9d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Going to try to terminate instance {{(pid=124431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:50:46.985547 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-bf8d7e88-778b-438e-89ee-1b9604a49b9d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 204 len: 0 microversion: 2.1 time: 0.140952 Aug 05 20:50:46.987476 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 444/920] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:50:46 2022] DELETE /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:50:46.994983 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8c7e806f-e134-4fe9-b492-3a16dee6ffdc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:46.995799 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-8c7e806f-e134-4fe9-b492-3a16dee6ffdc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:47.006869 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c7e806f-e134-4fe9-b492-3a16dee6ffdc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:47.007645 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c7e806f-e134-4fe9-b492-3a16dee6ffdc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:47.008321 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c7e806f-e134-4fe9-b492-3a16dee6ffdc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:47.009253 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c7e806f-e134-4fe9-b492-3a16dee6ffdc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:47.009907 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c7e806f-e134-4fe9-b492-3a16dee6ffdc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:47.010573 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-8c7e806f-e134-4fe9-b492-3a16dee6ffdc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:47.240256 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8073011b-5244-4b4e-a576-52110cf3264c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:47.242438 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8073011b-5244-4b4e-a576-52110cf3264c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:47.248579 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8073011b-5244-4b4e-a576-52110cf3264c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:47.249003 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8073011b-5244-4b4e-a576-52110cf3264c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:47.249638 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8073011b-5244-4b4e-a576-52110cf3264c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:47.250501 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8073011b-5244-4b4e-a576-52110cf3264c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:47.252614 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8073011b-5244-4b4e-a576-52110cf3264c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:47.252614 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8073011b-5244-4b4e-a576-52110cf3264c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:47.279931 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-8c7e806f-e134-4fe9-b492-3a16dee6ffdc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:47.283259 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8073011b-5244-4b4e-a576-52110cf3264c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047467 Aug 05 20:50:47.288127 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 445/921] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:47 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:47.288325 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8c7e806f-e134-4fe9-b492-3a16dee6ffdc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1683 microversion: 2.1 time: 0.297231 Aug 05 20:50:47.289071 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 477/922] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:46 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1683 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:47.293124 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-84f02c92-7bb8-4226-bea1-3c6700566b01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:47.293737 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-84f02c92-7bb8-4226-bea1-3c6700566b01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:47.300418 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-84f02c92-7bb8-4226-bea1-3c6700566b01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:47.300907 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-84f02c92-7bb8-4226-bea1-3c6700566b01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:47.301338 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-84f02c92-7bb8-4226-bea1-3c6700566b01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:47.302034 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-84f02c92-7bb8-4226-bea1-3c6700566b01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:47.302490 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-84f02c92-7bb8-4226-bea1-3c6700566b01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:47.302888 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-84f02c92-7bb8-4226-bea1-3c6700566b01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:47.316909 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-84f02c92-7bb8-4226-bea1-3c6700566b01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] HTTP exception thrown: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-84f02c92-7bb8-4226-bea1-3c6700566b01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Request method failure captured: Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 HTTP/1.1 Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YHscrmnsJNJm4x3MPaztFQvEa66JlKQwvTN3gQF-YBIBUWreJH7wNe5Jc3kShKEqwxSAaGQiwbd2g5E1-YlMOSU8ZAOteIncDpRCzpAI1jas8tB3zjOnVdU6iILeB6A5EBIvm_neDEY25RHgzXx3rU3zvqI1IjpmzVWk0Yi2pJ0Vd8 Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: c671352d2d2c475ab5c58932b6ecf5bc Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-TestVolumeBootPattern-882352379 Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:50:47.318702 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:50:47.320142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_c671352d2d2c475ab5c58932b6ecf5bc", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:47.320142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-TestVolumeBootPattern-882352379 Aug 05 20:50:47.320142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: c671352d2d2c475ab5c58932b6ecf5bc Aug 05 20:50:47.320142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-TestVolumeBootPattern-882352379 Aug 05 20:50:47.320142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-TestVolumeBootPattern-882352379-project Aug 05 20:50:47.320142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:50:47.320142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:50:47.320142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 9b5ea50e80674c9f96821af04540ba39 Aug 05 20:50:47.320142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-TestVolumeBootPattern-882352379-project Aug 05 20:50:47.320142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:50:47.320142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:50:47.320142 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '70c7ca7c-10a8-4b62-a82e-01b05bd4cf19'} Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:47.320936 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:50:47.322183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:47.323282 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-84f02c92-7bb8-4226-bea1-3c6700566b01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Returning 404 to user: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:47.323282 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-84f02c92-7bb8-4226-bea1-3c6700566b01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 404 len: 111 microversion: 2.1 time: 0.030769 Aug 05 20:50:47.323282 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 446/923] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:47 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:47.422777 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-505230764", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1555072571", "security_groups": [{"name": "tempest-secgroup-smoke-1169758282"}], "block_device_mapping_v2": [{"uuid": "1858415e-1fd2-406a-a3ef-3ddfd791b5f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2da7eabb-8388-4a2d-b214-d5f4a8b84731"}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:47.590533 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] validate_networks() for [('2da7eabb-8388-4a2d-b214-d5f4a8b84731', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:50:48.033623 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:50:48.034210 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:50:48.034502 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:50:48.035452 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:50:48.036064 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:50:48.045348 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:48.046085 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:48.046833 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:48.047778 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:48.048237 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:48.048834 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:48.067163 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Getting quotas for project c671352d2d2c475ab5c58932b6ecf5bc. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:50:48.071551 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Getting quotas for user 9b5ea50e80674c9f96821af04540ba39 and project c671352d2d2c475ab5c58932b6ecf5bc. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:50:48.134765 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:50:48.138939 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1858415e-1fd2-406a-a3ef-3ddfd791b5f3',volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:50:48.295602 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-2a0b217d-5a74-46c6-b53c-f97210289512 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:48.298054 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-2a0b217d-5a74-46c6-b53c-f97210289512 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:48.305319 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2a0b217d-5a74-46c6-b53c-f97210289512 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:48.305892 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2a0b217d-5a74-46c6-b53c-f97210289512 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:48.306548 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2a0b217d-5a74-46c6-b53c-f97210289512 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:48.307521 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2a0b217d-5a74-46c6-b53c-f97210289512 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:48.308183 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2a0b217d-5a74-46c6-b53c-f97210289512 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:48.308811 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2a0b217d-5a74-46c6-b53c-f97210289512 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:48.316597 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fdbd5b7b-4bf1-476c-af8d-424d818709e3 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.897953 Aug 05 20:50:48.317680 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 478/924] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:50:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:50:48.322365 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-f8e16d62-0cbd-4492-bb3c-93201b95944a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:48.323140 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-f8e16d62-0cbd-4492-bb3c-93201b95944a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:48.331840 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8e16d62-0cbd-4492-bb3c-93201b95944a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:48.332343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8e16d62-0cbd-4492-bb3c-93201b95944a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:48.333830 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8e16d62-0cbd-4492-bb3c-93201b95944a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:48.336287 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8e16d62-0cbd-4492-bb3c-93201b95944a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:48.336806 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8e16d62-0cbd-4492-bb3c-93201b95944a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:48.337250 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-f8e16d62-0cbd-4492-bb3c-93201b95944a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:48.346563 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-2a0b217d-5a74-46c6-b53c-f97210289512 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055024 Aug 05 20:50:48.351743 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 447/925] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:48 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:50:48.357311 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3356d071-138f-4b67-9469-a4c8ba4598a8 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:48.358172 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3356d071-138f-4b67-9469-a4c8ba4598a8 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:48.437500 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3356d071-138f-4b67-9469-a4c8ba4598a8 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:48.445094 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3356d071-138f-4b67-9469-a4c8ba4598a8 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1097 microversion: 2.1 time: 0.091435 Aug 05 20:50:48.445665 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 448/926] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:48 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1097 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:48.616628 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-f8e16d62-0cbd-4492-bb3c-93201b95944a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:48.628077 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:48.635014 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-f8e16d62-0cbd-4492-bb3c-93201b95944a tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1683 microversion: 2.1 time: 0.316223 Aug 05 20:50:48.636623 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 479/927] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:48 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1683 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:49.361908 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c206dc5f-065e-4999-b794-142d2789a230 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:49.366291 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c206dc5f-065e-4999-b794-142d2789a230 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:49.378858 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c206dc5f-065e-4999-b794-142d2789a230 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:49.379678 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c206dc5f-065e-4999-b794-142d2789a230 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:49.381913 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c206dc5f-065e-4999-b794-142d2789a230 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:49.383098 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c206dc5f-065e-4999-b794-142d2789a230 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:49.387645 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c206dc5f-065e-4999-b794-142d2789a230 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:49.388279 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c206dc5f-065e-4999-b794-142d2789a230 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:49.447753 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c206dc5f-065e-4999-b794-142d2789a230 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091099 Aug 05 20:50:49.448983 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 449/928] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:49 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:50:49.480369 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ab4e7b6a-6aa2-4a50-b2f4-776a88bf2da1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:49.481673 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ab4e7b6a-6aa2-4a50-b2f4-776a88bf2da1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:49.498548 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab4e7b6a-6aa2-4a50-b2f4-776a88bf2da1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:49.499193 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab4e7b6a-6aa2-4a50-b2f4-776a88bf2da1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:49.499779 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab4e7b6a-6aa2-4a50-b2f4-776a88bf2da1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:49.500724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab4e7b6a-6aa2-4a50-b2f4-776a88bf2da1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:49.501178 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab4e7b6a-6aa2-4a50-b2f4-776a88bf2da1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:49.501600 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ab4e7b6a-6aa2-4a50-b2f4-776a88bf2da1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:49.634265 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ab4e7b6a-6aa2-4a50-b2f4-776a88bf2da1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:49.644617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ab4e7b6a-6aa2-4a50-b2f4-776a88bf2da1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1203 microversion: 2.1 time: 0.181840 Aug 05 20:50:49.647686 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 480/929] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:49 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1203 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:49.654066 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-6e2173b1-7969-4fe2-9848-c84e7cae1a16 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:49.656727 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-6e2173b1-7969-4fe2-9848-c84e7cae1a16 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:49.671888 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6e2173b1-7969-4fe2-9848-c84e7cae1a16 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:49.674480 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4a86e926-7ade-48a4-9fcd-3e52d2c256e1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:49.676144 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4a86e926-7ade-48a4-9fcd-3e52d2c256e1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:49.681024 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6e2173b1-7969-4fe2-9848-c84e7cae1a16 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:49.681552 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6e2173b1-7969-4fe2-9848-c84e7cae1a16 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:49.682335 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6e2173b1-7969-4fe2-9848-c84e7cae1a16 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:49.683151 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6e2173b1-7969-4fe2-9848-c84e7cae1a16 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:49.683996 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6e2173b1-7969-4fe2-9848-c84e7cae1a16 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:49.698178 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4a86e926-7ade-48a4-9fcd-3e52d2c256e1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:49.699006 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4a86e926-7ade-48a4-9fcd-3e52d2c256e1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:49.702079 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4a86e926-7ade-48a4-9fcd-3e52d2c256e1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:49.706143 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4a86e926-7ade-48a4-9fcd-3e52d2c256e1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:49.707216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4a86e926-7ade-48a4-9fcd-3e52d2c256e1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:49.708557 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4a86e926-7ade-48a4-9fcd-3e52d2c256e1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:49.756576 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-6e2173b1-7969-4fe2-9848-c84e7cae1a16 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106914 Aug 05 20:50:49.774051 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 450/930] 10.222.0.100 () {58 vars in 1307 bytes} [Fri Aug 5 20:50:49 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 20:50:49.853126 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-6a9624c8-ab24-4370-bdd0-30ddc5c8c66e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:49.853554 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-6a9624c8-ab24-4370-bdd0-30ddc5c8c66e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:49.861139 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6a9624c8-ab24-4370-bdd0-30ddc5c8c66e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:49.862336 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6a9624c8-ab24-4370-bdd0-30ddc5c8c66e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:49.862792 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6a9624c8-ab24-4370-bdd0-30ddc5c8c66e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:49.863550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6a9624c8-ab24-4370-bdd0-30ddc5c8c66e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:49.864065 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6a9624c8-ab24-4370-bdd0-30ddc5c8c66e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:49.864796 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6a9624c8-ab24-4370-bdd0-30ddc5c8c66e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:49.910832 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4a86e926-7ade-48a4-9fcd-3e52d2c256e1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:49.918565 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-6a9624c8-ab24-4370-bdd0-30ddc5c8c66e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Going to try to terminate instance {{(pid=124431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:50:49.921498 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4a86e926-7ade-48a4-9fcd-3e52d2c256e1 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1615 microversion: 2.1 time: 0.260480 Aug 05 20:50:49.922501 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 481/931] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:49 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1615 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:50.048932 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-6a9624c8-ab24-4370-bdd0-30ddc5c8c66e tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 204 len: 0 microversion: 2.1 time: 0.199441 Aug 05 20:50:50.049689 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 451/932] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:50:49 2022] DELETE /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 20:50:50.058032 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ebe609cf-4f6e-417d-96a0-08dad12b57e0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:50.059036 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ebe609cf-4f6e-417d-96a0-08dad12b57e0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:50.069145 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebe609cf-4f6e-417d-96a0-08dad12b57e0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:50.069699 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebe609cf-4f6e-417d-96a0-08dad12b57e0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:50.070143 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebe609cf-4f6e-417d-96a0-08dad12b57e0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:50.070858 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebe609cf-4f6e-417d-96a0-08dad12b57e0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:50.071517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebe609cf-4f6e-417d-96a0-08dad12b57e0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:50.071951 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ebe609cf-4f6e-417d-96a0-08dad12b57e0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:50.382165 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-d8b33dca-ec83-4cbc-83c9-69eff2d1e490 req-891ee00e-e651-4a9b-9ef0-30a009245c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6304f059-f069-47d9-808f-7546856e6a12", "name": "network-vif-deleted", "tag": "61286b42-0dd3-4e59-a3e6-3d50dccc2a6d"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:50.393979 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-d8b33dca-ec83-4cbc-83c9-69eff2d1e490 req-891ee00e-e651-4a9b-9ef0-30a009245c7a service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:50.394882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-d8b33dca-ec83-4cbc-83c9-69eff2d1e490 req-891ee00e-e651-4a9b-9ef0-30a009245c7a service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:50.395698 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-d8b33dca-ec83-4cbc-83c9-69eff2d1e490 req-891ee00e-e651-4a9b-9ef0-30a009245c7a service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:50.396248 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ebe609cf-4f6e-417d-96a0-08dad12b57e0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:50.409464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-d8b33dca-ec83-4cbc-83c9-69eff2d1e490 req-891ee00e-e651-4a9b-9ef0-30a009245c7a service nova] Creating event network-vif-deleted:61286b42-0dd3-4e59-a3e6-3d50dccc2a6d for instance 6304f059-f069-47d9-808f-7546856e6a12 on hv-cinder-85220 Aug 05 20:50:50.410025 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ebe609cf-4f6e-417d-96a0-08dad12b57e0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1678 microversion: 2.1 time: 0.354829 Aug 05 20:50:50.410868 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 482/933] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:50 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1678 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:50.428583 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-d8b33dca-ec83-4cbc-83c9-69eff2d1e490 req-891ee00e-e651-4a9b-9ef0-30a009245c7a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050930 Aug 05 20:50:50.431248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 452/934] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:50.669493 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e16a6c70-6e48-4dd1-b782-f59741545ae7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:50.670195 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e16a6c70-6e48-4dd1-b782-f59741545ae7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:50.680623 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e16a6c70-6e48-4dd1-b782-f59741545ae7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:50.681390 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e16a6c70-6e48-4dd1-b782-f59741545ae7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:50.682031 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e16a6c70-6e48-4dd1-b782-f59741545ae7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:50.683235 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e16a6c70-6e48-4dd1-b782-f59741545ae7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:50.684574 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e16a6c70-6e48-4dd1-b782-f59741545ae7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:50.685178 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e16a6c70-6e48-4dd1-b782-f59741545ae7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:50.769611 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e16a6c70-6e48-4dd1-b782-f59741545ae7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:50.780905 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e16a6c70-6e48-4dd1-b782-f59741545ae7 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1213 microversion: 2.1 time: 0.115463 Aug 05 20:50:50.796526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 483/935] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:50 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:50.946808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-5d861e8f-9338-4c1d-abf6-3901c0db28c5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:50.948408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-5d861e8f-9338-4c1d-abf6-3901c0db28c5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:50.987155 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5d861e8f-9338-4c1d-abf6-3901c0db28c5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:50.987692 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5d861e8f-9338-4c1d-abf6-3901c0db28c5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:50.988122 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5d861e8f-9338-4c1d-abf6-3901c0db28c5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:50.989130 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5d861e8f-9338-4c1d-abf6-3901c0db28c5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:50.990422 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5d861e8f-9338-4c1d-abf6-3901c0db28c5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:50.991640 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5d861e8f-9338-4c1d-abf6-3901c0db28c5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:51.154223 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-967a9405-8435-4940-a7db-fd6639883a7d tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Action: 'create', calling method: .version_select at 0x7f9bf0031f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1261140864"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:51.260074 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-5d861e8f-9338-4c1d-abf6-3901c0db28c5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:51.268255 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-5d861e8f-9338-4c1d-abf6-3901c0db28c5 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1615 microversion: 2.1 time: 0.329394 Aug 05 20:50:51.269641 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 453/936] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:50 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1615 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:51.432348 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-5741c370-5d29-4104-a95f-3ba7ff546dea tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:51.433153 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-5741c370-5d29-4104-a95f-3ba7ff546dea tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:51.441639 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5741c370-5d29-4104-a95f-3ba7ff546dea tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:51.442219 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5741c370-5d29-4104-a95f-3ba7ff546dea tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:51.442735 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5741c370-5d29-4104-a95f-3ba7ff546dea tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:51.443723 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5741c370-5d29-4104-a95f-3ba7ff546dea tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:51.444339 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5741c370-5d29-4104-a95f-3ba7ff546dea tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:51.445002 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5741c370-5d29-4104-a95f-3ba7ff546dea tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:51.518390 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-967a9405-8435-4940-a7db-fd6639883a7d tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.542427 Aug 05 20:50:51.519460 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 484/937] 10.222.0.100 () {60 vars in 1160 bytes} [Fri Aug 5 20:50:50 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 544 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 05 20:50:51.533954 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9777103e-afcb-4acb-863b-b8c7c6aeef86 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9be768c4c0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:51.597235 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9777103e-afcb-4acb-863b-b8c7c6aeef86 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929" status: 200 len: 345 microversion: 2.1 time: 0.069192 Aug 05 20:50:51.604188 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 485/938] 10.222.0.100 () {58 vars in 1250 bytes} [Fri Aug 5 20:50:51 2022] GET /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929 => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:50:51.636971 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-5741c370-5d29-4104-a95f-3ba7ff546dea tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:51.644771 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-5741c370-5d29-4104-a95f-3ba7ff546dea tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1678 microversion: 2.1 time: 0.217414 Aug 05 20:50:51.645352 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 454/939] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:51 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:50:51.803088 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-73337430-e302-4889-89c6-3442892b4f78 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:51.803774 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-73337430-e302-4889-89c6-3442892b4f78 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:51.813961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73337430-e302-4889-89c6-3442892b4f78 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:51.814731 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73337430-e302-4889-89c6-3442892b4f78 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:51.815176 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73337430-e302-4889-89c6-3442892b4f78 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:51.815916 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73337430-e302-4889-89c6-3442892b4f78 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:51.816391 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73337430-e302-4889-89c6-3442892b4f78 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:51.816791 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73337430-e302-4889-89c6-3442892b4f78 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:52.073240 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-73337430-e302-4889-89c6-3442892b4f78 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:52.081872 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-73337430-e302-4889-89c6-3442892b4f78 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1281 microversion: 2.1 time: 0.283181 Aug 05 20:50:52.082453 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 486/940] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:51 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1281 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:52.290534 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-93030946-1c3a-40bd-ab70-b20bb0d50ba4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:52.291155 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-93030946-1c3a-40bd-ab70-b20bb0d50ba4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:52.297842 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-93030946-1c3a-40bd-ab70-b20bb0d50ba4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:52.298317 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-93030946-1c3a-40bd-ab70-b20bb0d50ba4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:52.299197 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-93030946-1c3a-40bd-ab70-b20bb0d50ba4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:52.300166 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-93030946-1c3a-40bd-ab70-b20bb0d50ba4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:52.300868 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-93030946-1c3a-40bd-ab70-b20bb0d50ba4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:52.301511 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-93030946-1c3a-40bd-ab70-b20bb0d50ba4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:52.335666 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-93030946-1c3a-40bd-ab70-b20bb0d50ba4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:52.336182 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-93030946-1c3a-40bd-ab70-b20bb0d50ba4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:52.336586 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-93030946-1c3a-40bd-ab70-b20bb0d50ba4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:52.337261 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-93030946-1c3a-40bd-ab70-b20bb0d50ba4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lazy-loading 'fault' on Instance uuid 6304f059-f069-47d9-808f-7546856e6a12 {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:50:52.417108 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-93030946-1c3a-40bd-ab70-b20bb0d50ba4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1baad75342476aa0c64bda0414e334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b67138a484f481099c562d7e3ca8401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:52.425396 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-93030946-1c3a-40bd-ab70-b20bb0d50ba4 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 200 len: 1334 microversion: 2.1 time: 0.139605 Aug 05 20:50:52.425969 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 455/941] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:52 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 1334 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:52.594109 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-04b1b0bb-7c6e-4c16-9376-78f24fbdd033 req-c5a1df04-cb9b-4173-8f61-de14fcd3b4aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce647114-7b2b-4ed1-94c2-93f5f7dface7", "tag": "ac1f9a37-2bdf-419a-83fe-c50df645c906"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:52.612119 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-2391840e-cca9-4154-a95d-4b0aaeb96b5f tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9be76aeca0>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:52.618118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-04b1b0bb-7c6e-4c16-9376-78f24fbdd033 req-c5a1df04-cb9b-4173-8f61-de14fcd3b4aa service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:52.625649 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-04b1b0bb-7c6e-4c16-9376-78f24fbdd033 req-c5a1df04-cb9b-4173-8f61-de14fcd3b4aa service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:52.626387 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-04b1b0bb-7c6e-4c16-9376-78f24fbdd033 req-c5a1df04-cb9b-4173-8f61-de14fcd3b4aa service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:52.639534 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-04b1b0bb-7c6e-4c16-9376-78f24fbdd033 req-c5a1df04-cb9b-4173-8f61-de14fcd3b4aa service nova] Creating event network-changed:ac1f9a37-2bdf-419a-83fe-c50df645c906 for instance ce647114-7b2b-4ed1-94c2-93f5f7dface7 on hv-cinder-85220 Aug 05 20:50:52.644667 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-04b1b0bb-7c6e-4c16-9376-78f24fbdd033 req-c5a1df04-cb9b-4173-8f61-de14fcd3b4aa service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055585 Aug 05 20:50:52.645925 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 487/942] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:52.668090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-42f626a1-952e-477b-b640-1dd23c7dc2c0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:52.668752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-42f626a1-952e-477b-b640-1dd23c7dc2c0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:52.669362 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-2391840e-cca9-4154-a95d-4b0aaeb96b5f tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929" status: 200 len: 346 microversion: 2.1 time: 0.060539 Aug 05 20:50:52.672156 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 456/943] 10.222.0.100 () {58 vars in 1250 bytes} [Fri Aug 5 20:50:52 2022] GET /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929 => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:52.683847 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-42f626a1-952e-477b-b640-1dd23c7dc2c0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:52.684648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-42f626a1-952e-477b-b640-1dd23c7dc2c0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:52.685073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-42f626a1-952e-477b-b640-1dd23c7dc2c0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:52.685248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-81a4f76a-e538-401e-b7ab-e095f0fca189 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Action: 'create', calling method: .version_select at 0x7f9be752fdc0>, body: {"snapshot": {"volume_id": "1ca7c0b3-1fef-4dff-95d3-916e69f59929", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1894497085"}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:52.685770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-42f626a1-952e-477b-b640-1dd23c7dc2c0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:52.686215 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-42f626a1-952e-477b-b640-1dd23c7dc2c0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:52.686645 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-42f626a1-952e-477b-b640-1dd23c7dc2c0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:52.856180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-81a4f76a-e538-401e-b7ab-e095f0fca189 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.175278 Aug 05 20:50:52.856985 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 457/944] 10.222.0.100 () {60 vars in 1167 bytes} [Fri Aug 5 20:50:52 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:50:52.868106 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f545d13b-731a-44e6-8e2e-d9192db7c998 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9be76f8790>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:52.918433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f545d13b-731a-44e6-8e2e-d9192db7c998 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4" status: 200 len: 287 microversion: 2.1 time: 0.054219 Aug 05 20:50:52.918998 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 458/945] 10.222.0.100 () {58 vars in 1256 bytes} [Fri Aug 5 20:50:52 2022] GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:50:52.930012 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ef0be66e-e247-49ed-8d68-8c23c6500671 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9be75dad30>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:52.969695 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ef0be66e-e247-49ed-8d68-8c23c6500671 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.043601 Aug 05 20:50:52.976061 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 459/946] 10.222.0.100 () {58 vars in 1145 bytes} [Fri Aug 5 20:50:52 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:50:52.981361 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0e43b2f6-60ec-4bfb-ace4-4900a429663e tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9be753c8b0>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:53.013654 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0e43b2f6-60ec-4bfb-ace4-4900a429663e tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4" status: 200 len: 287 microversion: 2.1 time: 0.036108 Aug 05 20:50:53.014338 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 460/947] 10.222.0.100 () {58 vars in 1256 bytes} [Fri Aug 5 20:50:52 2022] GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:50:53.077533 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-42f626a1-952e-477b-b640-1dd23c7dc2c0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:53.087279 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-42f626a1-952e-477b-b640-1dd23c7dc2c0 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1678 microversion: 2.1 time: 0.424575 Aug 05 20:50:53.097795 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 488/948] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:52 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1678 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:53.102619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a62c3e71-add7-4fc9-a9b0-81592b60f302 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:53.103287 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a62c3e71-add7-4fc9-a9b0-81592b60f302 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:53.111863 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a62c3e71-add7-4fc9-a9b0-81592b60f302 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:53.112423 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a62c3e71-add7-4fc9-a9b0-81592b60f302 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:53.112866 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a62c3e71-add7-4fc9-a9b0-81592b60f302 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:53.113601 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a62c3e71-add7-4fc9-a9b0-81592b60f302 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:53.114040 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a62c3e71-add7-4fc9-a9b0-81592b60f302 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:53.114491 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a62c3e71-add7-4fc9-a9b0-81592b60f302 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:53.366175 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a62c3e71-add7-4fc9-a9b0-81592b60f302 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:53.374439 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a62c3e71-add7-4fc9-a9b0-81592b60f302 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1269 microversion: 2.1 time: 0.275799 Aug 05 20:50:53.375043 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 461/949] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:53 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1269 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:53.446424 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-109db82f-c658-4f58-8433-39d73fcd5462 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:53.447029 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-109db82f-c658-4f58-8433-39d73fcd5462 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:53.453561 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-109db82f-c658-4f58-8433-39d73fcd5462 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:53.454046 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-109db82f-c658-4f58-8433-39d73fcd5462 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:53.454476 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-109db82f-c658-4f58-8433-39d73fcd5462 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:53.455154 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-109db82f-c658-4f58-8433-39d73fcd5462 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:53.455634 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-109db82f-c658-4f58-8433-39d73fcd5462 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:53.456052 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-109db82f-c658-4f58-8433-39d73fcd5462 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:53.470419 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-109db82f-c658-4f58-8433-39d73fcd5462 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] HTTP exception thrown: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-109db82f-c658-4f58-8433-39d73fcd5462 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Request method failure captured: Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 HTTP/1.1 Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEVT2RIo0sOYhrqEh_HYIhCXXgNEIU5O2TrKSb8O78pPQouV0XDBbsdQswVZsYX73wXTNNa6pCEJklCAufLFYW63yx7CPEVZ0Ry2Y0Ikjromqqlux7d4-wF_GlTFyol_iESoMY4-E-LXutqB0V3ogXtBOvhKaWzWfUtI3jvN-kS_PY Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:50:53.472148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:50:53.473581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8b67138a484f481099c562d7e3ca8401", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:53.473581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:53.473581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:53.473581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:53.473581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:53.473581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:50:53.473581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:50:53.473581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 8e1baad75342476aa0c64bda0414e334 Aug 05 20:50:53.473581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:53.473581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:50:53.473581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:53.473581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '6304f059-f069-47d9-808f-7546856e6a12'} Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:53.474437 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:53.475801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:53.476933 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-109db82f-c658-4f58-8433-39d73fcd5462 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Returning 404 to user: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:53.476933 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-109db82f-c658-4f58-8433-39d73fcd5462 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 404 len: 111 microversion: 2.1 time: 0.031095 Aug 05 20:50:53.477548 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 489/950] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:53 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:53.482952 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d838a1cc-ce82-49ca-af6a-138b083ecb6d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '.version_select at 0x7f9be76aeee0>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:53.504473 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d838a1cc-ce82-49ca-af6a-138b083ecb6d tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-759215415" status: 202 len: 0 microversion: 2.1 time: 0.025219 Aug 05 20:50:53.505090 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 462/951] 10.222.0.100 () {58 vars in 1223 bytes} [Fri Aug 5 20:50:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-759215415 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:50:54.027424 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-303118a3-b1f0-4588-8ef5-1e51ff066732 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9bf001d5e0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:54.061445 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-303118a3-b1f0-4588-8ef5-1e51ff066732 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4" status: 200 len: 287 microversion: 2.1 time: 0.038738 Aug 05 20:50:54.062220 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 490/952] 10.222.0.100 () {58 vars in 1256 bytes} [Fri Aug 5 20:50:54 2022] GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:54.112858 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1f78bdc3-b1a0-4058-a609-a7c4ffd5b913 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:54.114218 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-1f78bdc3-b1a0-4058-a609-a7c4ffd5b913 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:54.124198 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1f78bdc3-b1a0-4058-a609-a7c4ffd5b913 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:54.125091 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1f78bdc3-b1a0-4058-a609-a7c4ffd5b913 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:54.126074 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1f78bdc3-b1a0-4058-a609-a7c4ffd5b913 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:54.127727 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1f78bdc3-b1a0-4058-a609-a7c4ffd5b913 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:54.128520 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1f78bdc3-b1a0-4058-a609-a7c4ffd5b913 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:54.129113 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1f78bdc3-b1a0-4058-a609-a7c4ffd5b913 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:54.217516 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-1f78bdc3-b1a0-4058-a609-a7c4ffd5b913 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:54.233304 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-1f78bdc3-b1a0-4058-a609-a7c4ffd5b913 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1611 microversion: 2.1 time: 0.125340 Aug 05 20:50:54.234113 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 463/953] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:54 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1611 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:54.396867 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9c936c70-3fc2-4712-b112-68bcfc808ad9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:54.397648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9c936c70-3fc2-4712-b112-68bcfc808ad9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:54.406153 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c936c70-3fc2-4712-b112-68bcfc808ad9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:54.406684 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c936c70-3fc2-4712-b112-68bcfc808ad9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:54.407126 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c936c70-3fc2-4712-b112-68bcfc808ad9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:54.407902 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c936c70-3fc2-4712-b112-68bcfc808ad9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:54.408366 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c936c70-3fc2-4712-b112-68bcfc808ad9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:54.408779 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9c936c70-3fc2-4712-b112-68bcfc808ad9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:54.547382 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9c936c70-3fc2-4712-b112-68bcfc808ad9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:54.555599 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9c936c70-3fc2-4712-b112-68bcfc808ad9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1269 microversion: 2.1 time: 0.163444 Aug 05 20:50:54.556529 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 491/954] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:54 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:54.681652 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-953c409f-1add-4068-9099-646a04223fe0 req-9065b6df-0441-46ad-a661-08ae09227f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b095014-137c-4100-a4a2-69023e2cd17d", "name": "network-vif-deleted", "tag": "d2a706ca-b155-421d-9feb-94b85b3c5644"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:50:54.692167 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-953c409f-1add-4068-9099-646a04223fe0 req-9065b6df-0441-46ad-a661-08ae09227f2d service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:54.692654 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-953c409f-1add-4068-9099-646a04223fe0 req-9065b6df-0441-46ad-a661-08ae09227f2d service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:54.693082 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-953c409f-1add-4068-9099-646a04223fe0 req-9065b6df-0441-46ad-a661-08ae09227f2d service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:54.705404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-953c409f-1add-4068-9099-646a04223fe0 req-9065b6df-0441-46ad-a661-08ae09227f2d service nova] Creating event network-vif-deleted:d2a706ca-b155-421d-9feb-94b85b3c5644 for instance 0b095014-137c-4100-a4a2-69023e2cd17d on hv-cinder-85220 Aug 05 20:50:54.710852 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-953c409f-1add-4068-9099-646a04223fe0 req-9065b6df-0441-46ad-a661-08ae09227f2d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032930 Aug 05 20:50:54.711487 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 464/955] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:55.077520 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0e470f3f-6667-457c-9c95-8ac351882a0b tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9bf0031790>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:55.114215 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0e470f3f-6667-457c-9c95-8ac351882a0b tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4" status: 200 len: 287 microversion: 2.1 time: 0.042533 Aug 05 20:50:55.114760 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 492/956] 10.222.0.100 () {58 vars in 1256 bytes} [Fri Aug 5 20:50:55 2022] GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:55.257737 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e9b6495b-ce35-4eca-b302-4d752d4b17c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:55.258332 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e9b6495b-ce35-4eca-b302-4d752d4b17c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:55.265478 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e9b6495b-ce35-4eca-b302-4d752d4b17c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:55.266076 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e9b6495b-ce35-4eca-b302-4d752d4b17c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:55.266771 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e9b6495b-ce35-4eca-b302-4d752d4b17c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:55.267834 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e9b6495b-ce35-4eca-b302-4d752d4b17c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:55.268330 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e9b6495b-ce35-4eca-b302-4d752d4b17c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:55.268783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e9b6495b-ce35-4eca-b302-4d752d4b17c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:55.340496 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-e9b6495b-ce35-4eca-b302-4d752d4b17c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:55.348719 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e9b6495b-ce35-4eca-b302-4d752d4b17c7 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1327 microversion: 2.1 time: 0.095842 Aug 05 20:50:55.349292 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 465/957] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:55 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:55.580247 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e5fec88a-acf9-467d-873f-608a376fada6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:55.581105 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e5fec88a-acf9-467d-873f-608a376fada6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:55.591641 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e5fec88a-acf9-467d-873f-608a376fada6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:55.592456 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e5fec88a-acf9-467d-873f-608a376fada6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:55.593416 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e5fec88a-acf9-467d-873f-608a376fada6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:55.593881 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e5fec88a-acf9-467d-873f-608a376fada6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:55.594336 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e5fec88a-acf9-467d-873f-608a376fada6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:55.594762 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e5fec88a-acf9-467d-873f-608a376fada6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:55.741845 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e5fec88a-acf9-467d-873f-608a376fada6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:55.750036 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e5fec88a-acf9-467d-873f-608a376fada6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1269 microversion: 2.1 time: 0.176194 Aug 05 20:50:55.750645 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 493/958] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:55 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1269 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:56.130960 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1dbada70-2983-4c7e-a09f-dbebc2c09ae9 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9be74ae160>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:56.168024 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-1dbada70-2983-4c7e-a09f-dbebc2c09ae9 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4" status: 200 len: 288 microversion: 2.1 time: 0.042049 Aug 05 20:50:56.168658 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 466/959] 10.222.0.100 () {58 vars in 1256 bytes} [Fri Aug 5 20:50:56 2022] GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4 => generated 288 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:56.180115 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ebbd7c7c-1a60-4e7d-8185-4e737f634873 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9bf0031dc0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:56.243095 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ebbd7c7c-1a60-4e7d-8185-4e737f634873 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "DELETE /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4" status: 202 len: 0 microversion: 2.1 time: 0.066889 Aug 05 20:50:56.243790 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 494/960] 10.222.0.100 () {58 vars in 1259 bytes} [Fri Aug 5 20:50:56 2022] DELETE /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:50:56.253495 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-344a9de2-3837-490d-8c2e-8dd59bbfc905 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9be75daa60>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:56.285641 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-344a9de2-3837-490d-8c2e-8dd59bbfc905 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4" status: 200 len: 287 microversion: 2.1 time: 0.037338 Aug 05 20:50:56.286691 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 467/961] 10.222.0.100 () {58 vars in 1256 bytes} [Fri Aug 5 20:50:56 2022] GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:56.370461 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4c25fa75-c0bd-46f5-b5dd-4675f119771f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:56.371102 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4c25fa75-c0bd-46f5-b5dd-4675f119771f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:56.381090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c25fa75-c0bd-46f5-b5dd-4675f119771f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:56.381090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c25fa75-c0bd-46f5-b5dd-4675f119771f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:56.381090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c25fa75-c0bd-46f5-b5dd-4675f119771f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:56.381090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c25fa75-c0bd-46f5-b5dd-4675f119771f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:56.381576 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c25fa75-c0bd-46f5-b5dd-4675f119771f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:56.381576 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c25fa75-c0bd-46f5-b5dd-4675f119771f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:56.386980 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-15564089-2311-4c57-8259-0514db0addb9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:56.387532 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-15564089-2311-4c57-8259-0514db0addb9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:56.395159 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15564089-2311-4c57-8259-0514db0addb9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:56.395783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15564089-2311-4c57-8259-0514db0addb9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:56.396289 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15564089-2311-4c57-8259-0514db0addb9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:56.397330 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15564089-2311-4c57-8259-0514db0addb9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:56.397841 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15564089-2311-4c57-8259-0514db0addb9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:56.398273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-15564089-2311-4c57-8259-0514db0addb9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:56.414025 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-15564089-2311-4c57-8259-0514db0addb9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] HTTP exception thrown: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:56.415758 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c25fa75-c0bd-46f5-b5dd-4675f119771f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-15564089-2311-4c57-8259-0514db0addb9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Request method failure captured: Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: DELETE /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 HTTP/1.1 Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEVT2RIo0sOYhrqEh_HYIhCXXgNEIU5O2TrKSb8O78pPQouV0XDBbsdQswVZsYX73wXTNNa6pCEJklCAufLFYW63yx7CPEVZ0Ry2Y0Ikjromqqlux7d4-wF_GlTFyol_iESoMY4-E-LXutqB0V3ogXtBOvhKaWzWfUtI3jvN-kS_PY Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:50:56.415911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:50:56.417551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8b67138a484f481099c562d7e3ca8401", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:56.417551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:56.417551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:56.417551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:56.417551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:56.417551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:50:56.417551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:50:56.417551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 8e1baad75342476aa0c64bda0414e334 Aug 05 20:50:56.417551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:56.417551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:50:56.417551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:56.417551 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '6304f059-f069-47d9-808f-7546856e6a12'} Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:56.421905 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:56.423810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:56.425560 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c25fa75-c0bd-46f5-b5dd-4675f119771f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:56.425688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-15564089-2311-4c57-8259-0514db0addb9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Returning 404 to user: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:56.425802 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4c25fa75-c0bd-46f5-b5dd-4675f119771f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:56.425802 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-4c25fa75-c0bd-46f5-b5dd-4675f119771f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lazy-loading 'fault' on Instance uuid 0b095014-137c-4100-a4a2-69023e2cd17d {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:50:56.425974 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-15564089-2311-4c57-8259-0514db0addb9 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 404 len: 111 microversion: 2.1 time: 0.034771 Aug 05 20:50:56.425974 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 468/962] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:50:56 2022] DELETE /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:50:56.427029 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a105e96d-f0eb-4c33-b966-1981470641af tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:56.427955 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a105e96d-f0eb-4c33-b966-1981470641af tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 6304f059-f069-47d9-808f-7546856e6a12] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:56.434944 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a105e96d-f0eb-4c33-b966-1981470641af tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:56.435473 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a105e96d-f0eb-4c33-b966-1981470641af tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:56.435948 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a105e96d-f0eb-4c33-b966-1981470641af tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:56.436654 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a105e96d-f0eb-4c33-b966-1981470641af tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:56.437190 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a105e96d-f0eb-4c33-b966-1981470641af tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:56.437615 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a105e96d-f0eb-4c33-b966-1981470641af tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:56.442147 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:56.452801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-a105e96d-f0eb-4c33-b966-1981470641af tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] HTTP exception thrown: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a105e96d-f0eb-4c33-b966-1981470641af tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Request method failure captured: Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 HTTP/1.1 Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEVT2RIo0sOYhrqEh_HYIhCXXgNEIU5O2TrKSb8O78pPQouV0XDBbsdQswVZsYX73wXTNNa6pCEJklCAufLFYW63yx7CPEVZ0Ry2Y0Ikjromqqlux7d4-wF_GlTFyol_iESoMY4-E-LXutqB0V3ogXtBOvhKaWzWfUtI3jvN-kS_PY Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:50:56.454357 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:50:56.455895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8b67138a484f481099c562d7e3ca8401", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:56.455895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:56.455895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:56.455895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:56.455895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:56.455895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:50:56.455895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:50:56.455895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 8e1baad75342476aa0c64bda0414e334 Aug 05 20:50:56.455895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:56.455895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:50:56.455895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:56.455895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '6304f059-f069-47d9-808f-7546856e6a12'} Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:56.456705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. Aug 05 20:50:56.458273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:56.460023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a105e96d-f0eb-4c33-b966-1981470641af tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Returning 404 to user: Instance 6304f059-f069-47d9-808f-7546856e6a12 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:56.460023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a105e96d-f0eb-4c33-b966-1981470641af tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12" status: 404 len: 111 microversion: 2.1 time: 0.033545 Aug 05 20:50:56.460023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 469/963] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:56 2022] GET /compute/v2.1/servers/6304f059-f069-47d9-808f-7546856e6a12 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:50:56.530735 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4c25fa75-c0bd-46f5-b5dd-4675f119771f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396a79cbb4e9494791422713c596bc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae12b8f8a7f40758ca0edaeea7022ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:56.541867 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4c25fa75-c0bd-46f5-b5dd-4675f119771f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 200 len: 1332 microversion: 2.1 time: 0.175532 Aug 05 20:50:56.543487 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 495/964] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:56 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 1332 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:56.780270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-01272699-e11e-40c0-a713-1d7919211069 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:56.781199 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-01272699-e11e-40c0-a713-1d7919211069 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:56.789214 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-01272699-e11e-40c0-a713-1d7919211069 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:56.789722 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-01272699-e11e-40c0-a713-1d7919211069 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:56.790132 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-01272699-e11e-40c0-a713-1d7919211069 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:56.790830 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-01272699-e11e-40c0-a713-1d7919211069 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:56.792520 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-01272699-e11e-40c0-a713-1d7919211069 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:56.792952 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-01272699-e11e-40c0-a713-1d7919211069 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:57.016784 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-01272699-e11e-40c0-a713-1d7919211069 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:57.024755 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-01272699-e11e-40c0-a713-1d7919211069 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1269 microversion: 2.1 time: 0.249979 Aug 05 20:50:57.025341 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 470/965] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:56 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1269 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:50:57.299257 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-066e3e15-7dc8-4b88-b964-f3ec6f2a89b5 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9be77285e0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:57.330524 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-066e3e15-7dc8-4b88-b964-f3ec6f2a89b5 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] HTTP exception thrown: Snapshot 6678b607-b0b2-4df7-9bef-177d120224d4 could not be found. Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-066e3e15-7dc8-4b88-b964-f3ec6f2a89b5 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Request method failure captured: Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4 HTTP/1.1 Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YKqZ-W8DjzqNtgqoz852eB3495zQPXwUfP2hmK7moIu-wMn-Wt44fNXVPgqyyjpUE1Pfo9GkNosKJ4mUqJ6eGo9FCKwxiPur3JVvSfJyUC6Mh-nWhtdmTu3bn7RlIn2sh7aAtvXI4pyAKzxh-PAcXvl9VeSVwmwEjvRJEts8zyQEFo Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 2b483d1095ff4ac8845d0bb7325ae382 Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-408362253 Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:50:57.332897 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:50:57.334644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2b483d1095ff4ac8845d0bb7325ae382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2b483d1095ff4ac8845d0bb7325ae382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2b483d1095ff4ac8845d0bb7325ae382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2b483d1095ff4ac8845d0bb7325ae382", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:57.334644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesSnapshotsTestJSON-408362253 Aug 05 20:50:57.334644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 2b483d1095ff4ac8845d0bb7325ae382 Aug 05 20:50:57.334644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-408362253 Aug 05 20:50:57.334644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesSnapshotsTestJSON-408362253-project Aug 05 20:50:57.334644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:50:57.334644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:50:57.334644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: e9df11ae71d2493f82644ac4ed1a95b0 Aug 05 20:50:57.334644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesSnapshotsTestJSON-408362253-project Aug 05 20:50:57.334644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: Aug 05 20:50:57.334644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Snapshot 6678b607-b0b2-4df7-9bef-177d120224d4 could not be found. Aug 05 20:50:57.334644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '6678b607-b0b2-4df7-9bef-177d120224d4'} Aug 05 20:50:57.334644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6678b607-b0b2-4df7-9bef-177d120224d4 could not be found. (HTTP 404) (Request-ID: req-9dfc78b6-5b23-4789-aa77-45c127ee3299) Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.335738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:50:57.337124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6678b607-b0b2-4df7-9bef-177d120224d4 could not be found. Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 05 20:50:57.338510 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:57.340300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6678b607-b0b2-4df7-9bef-177d120224d4 could not be found. Aug 05 20:50:57.340300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.340300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:57.340300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.340300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.340300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:57.340300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:57.340300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:57.340300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:57.340300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6678b607-b0b2-4df7-9bef-177d120224d4 could not be found. Aug 05 20:50:57.340300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.340300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-066e3e15-7dc8-4b88-b964-f3ec6f2a89b5 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Returning 404 to user: Snapshot 6678b607-b0b2-4df7-9bef-177d120224d4 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:57.340300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-066e3e15-7dc8-4b88-b964-f3ec6f2a89b5 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4" status: 404 len: 111 microversion: 2.1 time: 0.039527 Aug 05 20:50:57.341668 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 496/966] 10.222.0.100 () {58 vars in 1256 bytes} [Fri Aug 5 20:50:57 2022] GET /compute/v2.1/os-snapshots/6678b607-b0b2-4df7-9bef-177d120224d4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:57.345350 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-33ed9571-9e72-4f96-8008-0856c5c86b9f tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9be768ef70>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:57.419811 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-33ed9571-9e72-4f96-8008-0856c5c86b9f tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929" status: 202 len: 0 microversion: 2.1 time: 0.080027 Aug 05 20:50:57.420358 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 471/967] 10.222.0.100 () {58 vars in 1253 bytes} [Fri Aug 5 20:50:57 2022] DELETE /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:50:57.429021 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ce1c35ba-5dd6-42f4-8aac-6bda5b9d98b8 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9be774b280>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:57.479579 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ce1c35ba-5dd6-42f4-8aac-6bda5b9d98b8 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929" status: 200 len: 345 microversion: 2.1 time: 0.054407 Aug 05 20:50:57.480185 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 497/968] 10.222.0.100 () {58 vars in 1250 bytes} [Fri Aug 5 20:50:57 2022] GET /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:50:57.562563 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9855d7a0-eeca-4b62-8cf9-206926bf7397 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:57.563260 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9855d7a0-eeca-4b62-8cf9-206926bf7397 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:57.570034 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9855d7a0-eeca-4b62-8cf9-206926bf7397 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:57.570593 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9855d7a0-eeca-4b62-8cf9-206926bf7397 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:57.571055 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9855d7a0-eeca-4b62-8cf9-206926bf7397 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:57.571786 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9855d7a0-eeca-4b62-8cf9-206926bf7397 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:57.572245 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9855d7a0-eeca-4b62-8cf9-206926bf7397 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:57.572677 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9855d7a0-eeca-4b62-8cf9-206926bf7397 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:57.587109 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-9855d7a0-eeca-4b62-8cf9-206926bf7397 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] HTTP exception thrown: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9855d7a0-eeca-4b62-8cf9-206926bf7397 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Request method failure captured: Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d HTTP/1.1 Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEXspSy7q1zy4V9Cv4aRjZ03fZpiLNmcRvWN6KVoc09VMqrJcz58m2sy75emj-7EcDSb3hAjyBesDI93PKpt5EBFfPqLmGvPDhB5mO2IRQ6FL-vUjtGnRYiVrh_KI_n6qQumKkNVwxY2tokLdVj7j-H0EthC5kOK1UwqZTHvtjW1gs Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 2ae12b8f8a7f40758ca0edaeea7022ab Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:50:57.588821 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:50:57.590180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2ae12b8f8a7f40758ca0edaeea7022ab", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:57.590180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:50:57.590180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 2ae12b8f8a7f40758ca0edaeea7022ab Aug 05 20:50:57.590180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:50:57.590180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-AttachVolumeTestJSON-1543654885-project Aug 05 20:50:57.590180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:50:57.590180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:50:57.590180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 396a79cbb4e9494791422713c596bc0c Aug 05 20:50:57.590180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-AttachVolumeTestJSON-1543654885-project Aug 05 20:50:57.590180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:50:57.590180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:50:57.590180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '0b095014-137c-4100-a4a2-69023e2cd17d'} Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:57.590935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:50:57.592270 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.593717 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9855d7a0-eeca-4b62-8cf9-206926bf7397 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Returning 404 to user: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:57.593717 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9855d7a0-eeca-4b62-8cf9-206926bf7397 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 404 len: 111 microversion: 2.1 time: 0.031833 Aug 05 20:50:57.593717 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 472/969] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:57 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:57.599551 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c49d5b3d-4012-4495-b2c9-2e704136438f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '.version_select at 0x7f9be7728940>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:57.621289 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c49d5b3d-4012-4495-b2c9-2e704136438f tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1497565594" status: 202 len: 0 microversion: 2.1 time: 0.025475 Aug 05 20:50:57.621870 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 498/970] 10.222.0.100 () {58 vars in 1226 bytes} [Fri Aug 5 20:50:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1497565594 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:50:57.622741 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-26aa1318-f55b-47bb-8d39-c2511bec78a8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:57.623240 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-26aa1318-f55b-47bb-8d39-c2511bec78a8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:57.629793 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-26aa1318-f55b-47bb-8d39-c2511bec78a8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:57.630281 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-26aa1318-f55b-47bb-8d39-c2511bec78a8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:57.630708 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-26aa1318-f55b-47bb-8d39-c2511bec78a8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:57.631428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-26aa1318-f55b-47bb-8d39-c2511bec78a8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:57.632125 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-26aa1318-f55b-47bb-8d39-c2511bec78a8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:57.632311 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-26aa1318-f55b-47bb-8d39-c2511bec78a8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:57.646858 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-26aa1318-f55b-47bb-8d39-c2511bec78a8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] HTTP exception thrown: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-26aa1318-f55b-47bb-8d39-c2511bec78a8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Request method failure captured: Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: DELETE /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 HTTP/1.1 Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEVT2RIo0sOYhrqEh_HYIhCXXgNEIU5O2TrKSb8O78pPQouV0XDBbsdQswVZsYX73wXTNNa6pCEJklCAufLFYW63yx7CPEVZ0Ry2Y0Ikjromqqlux7d4-wF_GlTFyol_iESoMY4-E-LXutqB0V3ogXtBOvhKaWzWfUtI3jvN-kS_PY Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:50:57.648464 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:50:57.649978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8b67138a484f481099c562d7e3ca8401", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:57.649978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:57.649978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:57.649978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:57.649978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:57.649978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:50:57.649978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:50:57.649978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 8e1baad75342476aa0c64bda0414e334 Aug 05 20:50:57.649978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:57.649978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:50:57.649978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:50:57.649978 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '26a70e3c-12e4-4459-b22d-b9152f1987c1'} Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:57.651224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:50:57.652509 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.655166 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-26aa1318-f55b-47bb-8d39-c2511bec78a8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Returning 404 to user: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:57.655166 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-26aa1318-f55b-47bb-8d39-c2511bec78a8 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 404 len: 111 microversion: 2.1 time: 0.031476 Aug 05 20:50:57.655166 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 473/971] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:50:57 2022] DELETE /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:57.661199 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e0526a17-ac70-43ef-86ff-9e376374b6a2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:57.662003 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e0526a17-ac70-43ef-86ff-9e376374b6a2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 26a70e3c-12e4-4459-b22d-b9152f1987c1] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:57.668982 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e0526a17-ac70-43ef-86ff-9e376374b6a2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:57.669628 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e0526a17-ac70-43ef-86ff-9e376374b6a2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:57.670184 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e0526a17-ac70-43ef-86ff-9e376374b6a2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:57.671100 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e0526a17-ac70-43ef-86ff-9e376374b6a2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:57.671727 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e0526a17-ac70-43ef-86ff-9e376374b6a2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:57.672326 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e0526a17-ac70-43ef-86ff-9e376374b6a2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:57.687188 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-e0526a17-ac70-43ef-86ff-9e376374b6a2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] HTTP exception thrown: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e0526a17-ac70-43ef-86ff-9e376374b6a2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Request method failure captured: Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 HTTP/1.1 Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEVT2RIo0sOYhrqEh_HYIhCXXgNEIU5O2TrKSb8O78pPQouV0XDBbsdQswVZsYX73wXTNNa6pCEJklCAufLFYW63yx7CPEVZ0Ry2Y0Ikjromqqlux7d4-wF_GlTFyol_iESoMY4-E-LXutqB0V3ogXtBOvhKaWzWfUtI3jvN-kS_PY Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:50:57.689027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:50:57.690470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8b67138a484f481099c562d7e3ca8401", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:57.690470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:57.690470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:57.690470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:57.690470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:57.690470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:50:57.690470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:50:57.690470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 8e1baad75342476aa0c64bda0414e334 Aug 05 20:50:57.690470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:57.690470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:50:57.690470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:50:57.690470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '26a70e3c-12e4-4459-b22d-b9152f1987c1'} Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:57.691343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. Aug 05 20:50:57.693243 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.695287 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e0526a17-ac70-43ef-86ff-9e376374b6a2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Returning 404 to user: Instance 26a70e3c-12e4-4459-b22d-b9152f1987c1 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:57.695287 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e0526a17-ac70-43ef-86ff-9e376374b6a2 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1" status: 404 len: 111 microversion: 2.1 time: 0.034899 Aug 05 20:50:57.695287 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 499/972] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:57 2022] GET /compute/v2.1/servers/26a70e3c-12e4-4459-b22d-b9152f1987c1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:57.701353 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c482784b-9600-4b4d-ab78-aea40bb49d78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:57.701919 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-c482784b-9600-4b4d-ab78-aea40bb49d78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:57.708339 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c482784b-9600-4b4d-ab78-aea40bb49d78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:57.708826 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c482784b-9600-4b4d-ab78-aea40bb49d78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:57.709260 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c482784b-9600-4b4d-ab78-aea40bb49d78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:57.709954 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c482784b-9600-4b4d-ab78-aea40bb49d78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:57.710428 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c482784b-9600-4b4d-ab78-aea40bb49d78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:57.710844 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-c482784b-9600-4b4d-ab78-aea40bb49d78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:57.724715 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-c482784b-9600-4b4d-ab78-aea40bb49d78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] HTTP exception thrown: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c482784b-9600-4b4d-ab78-aea40bb49d78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Request method failure captured: Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: DELETE /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 HTTP/1.1 Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEVT2RIo0sOYhrqEh_HYIhCXXgNEIU5O2TrKSb8O78pPQouV0XDBbsdQswVZsYX73wXTNNa6pCEJklCAufLFYW63yx7CPEVZ0Ry2Y0Ikjromqqlux7d4-wF_GlTFyol_iESoMY4-E-LXutqB0V3ogXtBOvhKaWzWfUtI3jvN-kS_PY Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:50:57.726314 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:50:57.728023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8b67138a484f481099c562d7e3ca8401", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:57.728023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:57.728023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:57.728023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:57.728023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:57.728023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:50:57.728023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:50:57.728023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 8e1baad75342476aa0c64bda0414e334 Aug 05 20:50:57.728023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:57.728023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:50:57.728023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:50:57.728023 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '784e7d44-0869-48e1-84f5-e35567f73947'} Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:57.728794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:50:57.730072 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.731296 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-c482784b-9600-4b4d-ab78-aea40bb49d78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Returning 404 to user: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:57.731296 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-c482784b-9600-4b4d-ab78-aea40bb49d78 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 404 len: 111 microversion: 2.1 time: 0.031234 Aug 05 20:50:57.731296 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 474/973] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:50:57 2022] DELETE /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:57.736390 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-81eb4d54-041a-4af2-81d9-44834a88b373 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:57.737006 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-81eb4d54-041a-4af2-81d9-44834a88b373 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: 784e7d44-0869-48e1-84f5-e35567f73947] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:57.742941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-81eb4d54-041a-4af2-81d9-44834a88b373 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:57.743448 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-81eb4d54-041a-4af2-81d9-44834a88b373 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:57.743877 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-81eb4d54-041a-4af2-81d9-44834a88b373 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:57.744564 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-81eb4d54-041a-4af2-81d9-44834a88b373 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:57.745004 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-81eb4d54-041a-4af2-81d9-44834a88b373 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:57.745422 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-81eb4d54-041a-4af2-81d9-44834a88b373 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:57.760096 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-81eb4d54-041a-4af2-81d9-44834a88b373 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] HTTP exception thrown: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-81eb4d54-041a-4af2-81d9-44834a88b373 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Request method failure captured: Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 HTTP/1.1 Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEVT2RIo0sOYhrqEh_HYIhCXXgNEIU5O2TrKSb8O78pPQouV0XDBbsdQswVZsYX73wXTNNa6pCEJklCAufLFYW63yx7CPEVZ0Ry2Y0Ikjromqqlux7d4-wF_GlTFyol_iESoMY4-E-LXutqB0V3ogXtBOvhKaWzWfUtI3jvN-kS_PY Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:50:57.761764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:50:57.763119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8b67138a484f481099c562d7e3ca8401", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:57.763119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:57.763119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:57.763119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:57.763119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:57.763119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:50:57.763119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:50:57.763119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 8e1baad75342476aa0c64bda0414e334 Aug 05 20:50:57.763119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:57.763119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:50:57.763119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:50:57.763119 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '784e7d44-0869-48e1-84f5-e35567f73947'} Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:57.764002 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. Aug 05 20:50:57.765216 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:57.766377 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-81eb4d54-041a-4af2-81d9-44834a88b373 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Returning 404 to user: Instance 784e7d44-0869-48e1-84f5-e35567f73947 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:57.766377 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-81eb4d54-041a-4af2-81d9-44834a88b373 tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947" status: 404 len: 111 microversion: 2.1 time: 0.030867 Aug 05 20:50:57.766377 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 500/974] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:57 2022] GET /compute/v2.1/servers/784e7d44-0869-48e1-84f5-e35567f73947 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:50:58.046562 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-55f78f4f-d953-4f86-82ed-845ef6c30561 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:58.047538 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-55f78f4f-d953-4f86-82ed-845ef6c30561 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:58.049705 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:58.054889 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-55f78f4f-d953-4f86-82ed-845ef6c30561 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:58.055404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-55f78f4f-d953-4f86-82ed-845ef6c30561 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:58.055849 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-55f78f4f-d953-4f86-82ed-845ef6c30561 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:58.056577 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-55f78f4f-d953-4f86-82ed-845ef6c30561 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:58.057204 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-55f78f4f-d953-4f86-82ed-845ef6c30561 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:58.057631 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-55f78f4f-d953-4f86-82ed-845ef6c30561 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:58.248755 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-55f78f4f-d953-4f86-82ed-845ef6c30561 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:58.257731 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-55f78f4f-d953-4f86-82ed-845ef6c30561 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1269 microversion: 2.1 time: 0.215092 Aug 05 20:50:58.258344 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 475/975] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:58 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1269 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:50:58.494400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8cfcda8a-e578-4608-b829-87ac9bea77cf tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9bf001dee0>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:58.501284 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:58.502039 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:58.527407 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-8cfcda8a-e578-4608-b829-87ac9bea77cf tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] HTTP exception thrown: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8cfcda8a-e578-4608-b829-87ac9bea77cf tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Request method failure captured: Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929 HTTP/1.1 Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YKqZ-W8DjzqNtgqoz852eB3495zQPXwUfP2hmK7moIu-wMn-Wt44fNXVPgqyyjpUE1Pfo9GkNosKJ4mUqJ6eGo9FCKwxiPur3JVvSfJyUC6Mh-nWhtdmTu3bn7RlIn2sh7aAtvXI4pyAKzxh-PAcXvl9VeSVwmwEjvRJEts8zyQEFo Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 2b483d1095ff4ac8845d0bb7325ae382 Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-408362253 Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:50:58.529472 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:50:58.530997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2b483d1095ff4ac8845d0bb7325ae382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2b483d1095ff4ac8845d0bb7325ae382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2b483d1095ff4ac8845d0bb7325ae382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2b483d1095ff4ac8845d0bb7325ae382", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:58.530997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesSnapshotsTestJSON-408362253 Aug 05 20:50:58.530997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 2b483d1095ff4ac8845d0bb7325ae382 Aug 05 20:50:58.530997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-408362253 Aug 05 20:50:58.530997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesSnapshotsTestJSON-408362253-project Aug 05 20:50:58.530997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:50:58.530997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:50:58.530997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: e9df11ae71d2493f82644ac4ed1a95b0 Aug 05 20:50:58.530997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesSnapshotsTestJSON-408362253-project Aug 05 20:50:58.530997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: Aug 05 20:50:58.530997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.530997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '1ca7c0b3-1fef-4dff-95d3-916e69f59929'} Aug 05 20:50:58.530997 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. (HTTP 404) (Request-ID: req-975e17eb-753e-4a7f-b46d-dd09d2164375) Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:58.532227 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:50:58.533517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 20:50:58.534671 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:58.536067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.536067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.536067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:58.536067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.536067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.536067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:58.536067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:58.536067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:58.536067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:58.536067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.536067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.536067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-8cfcda8a-e578-4608-b829-87ac9bea77cf tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Returning 404 to user: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:58.536067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-8cfcda8a-e578-4608-b829-87ac9bea77cf tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929" status: 404 len: 109 microversion: 2.1 time: 0.040521 Aug 05 20:50:58.536067 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 501/976] 10.222.0.100 () {58 vars in 1250 bytes} [Fri Aug 5 20:50:58 2022] GET /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:58.545144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1d23d5bf-9485-4316-a7c2-cffd6af69623 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9be752fdc0>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:58.551898 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:50:58.576047 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-1d23d5bf-9485-4316-a7c2-cffd6af69623 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] HTTP exception thrown: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1d23d5bf-9485-4316-a7c2-cffd6af69623 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Request method failure captured: Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: DELETE /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929 HTTP/1.1 Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YKqZ-W8DjzqNtgqoz852eB3495zQPXwUfP2hmK7moIu-wMn-Wt44fNXVPgqyyjpUE1Pfo9GkNosKJ4mUqJ6eGo9FCKwxiPur3JVvSfJyUC6Mh-nWhtdmTu3bn7RlIn2sh7aAtvXI4pyAKzxh-PAcXvl9VeSVwmwEjvRJEts8zyQEFo Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 2b483d1095ff4ac8845d0bb7325ae382 Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-408362253 Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:50:58.578056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:50:58.580128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2b483d1095ff4ac8845d0bb7325ae382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2b483d1095ff4ac8845d0bb7325ae382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2b483d1095ff4ac8845d0bb7325ae382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2b483d1095ff4ac8845d0bb7325ae382", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:58.580128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-VolumesSnapshotsTestJSON-408362253 Aug 05 20:50:58.580128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 2b483d1095ff4ac8845d0bb7325ae382 Aug 05 20:50:58.580128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-408362253 Aug 05 20:50:58.580128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-VolumesSnapshotsTestJSON-408362253-project Aug 05 20:50:58.580128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:50:58.580128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:50:58.580128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: e9df11ae71d2493f82644ac4ed1a95b0 Aug 05 20:50:58.580128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-VolumesSnapshotsTestJSON-408362253-project Aug 05 20:50:58.580128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: Aug 05 20:50:58.580128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.580128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '1ca7c0b3-1fef-4dff-95d3-916e69f59929'} Aug 05 20:50:58.580128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. (HTTP 404) (Request-ID: req-a45750aa-f9ec-4902-a525-bda838700861) Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:58.581117 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 20:50:58.582550 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 20:50:58.583939 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:58.585408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.585408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.585408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:58.585408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.585408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.585408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:58.585408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:58.585408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:58.585408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:58.585408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.585408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.585408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1d23d5bf-9485-4316-a7c2-cffd6af69623 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Returning 404 to user: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:58.585408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-1d23d5bf-9485-4316-a7c2-cffd6af69623 tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929" status: 404 len: 109 microversion: 2.1 time: 0.038411 Aug 05 20:50:58.585408 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 476/977] 10.222.0.100 () {58 vars in 1253 bytes} [Fri Aug 5 20:50:58 2022] DELETE /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:58.589586 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7987c330-279e-4f24-b842-00a18928699a tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Calling method '.version_select at 0x7f9be76f6700>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:58.618034 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-7987c330-279e-4f24-b842-00a18928699a tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] HTTP exception thrown: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7987c330-279e-4f24-b842-00a18928699a tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Request method failure captured: Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929 HTTP/1.1 Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YKqZ-W8DjzqNtgqoz852eB3495zQPXwUfP2hmK7moIu-wMn-Wt44fNXVPgqyyjpUE1Pfo9GkNosKJ4mUqJ6eGo9FCKwxiPur3JVvSfJyUC6Mh-nWhtdmTu3bn7RlIn2sh7aAtvXI4pyAKzxh-PAcXvl9VeSVwmwEjvRJEts8zyQEFo Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 2b483d1095ff4ac8845d0bb7325ae382 Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-408362253 Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:50:58.620400 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:50:58.621953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2b483d1095ff4ac8845d0bb7325ae382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2b483d1095ff4ac8845d0bb7325ae382"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2b483d1095ff4ac8845d0bb7325ae382"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2b483d1095ff4ac8845d0bb7325ae382", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:58.621953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesSnapshotsTestJSON-408362253 Aug 05 20:50:58.621953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 2b483d1095ff4ac8845d0bb7325ae382 Aug 05 20:50:58.621953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-408362253 Aug 05 20:50:58.621953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesSnapshotsTestJSON-408362253-project Aug 05 20:50:58.621953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:50:58.621953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:50:58.621953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: e9df11ae71d2493f82644ac4ed1a95b0 Aug 05 20:50:58.621953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesSnapshotsTestJSON-408362253-project Aug 05 20:50:58.621953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: Aug 05 20:50:58.621953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.621953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '1ca7c0b3-1fef-4dff-95d3-916e69f59929'} Aug 05 20:50:58.621953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. (HTTP 404) (Request-ID: req-6344a42e-c57d-4724-8936-9e5b9c2c2276) Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:58.622969 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 20:50:58.624420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 20:50:58.625770 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:58.627118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.627118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.627118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:58.627118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.627118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.627118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:58.627118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:58.627118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:58.627118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:58.627118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. Aug 05 20:50:58.627118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.627118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7987c330-279e-4f24-b842-00a18928699a tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] Returning 404 to user: Volume 1ca7c0b3-1fef-4dff-95d3-916e69f59929 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:58.627118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7987c330-279e-4f24-b842-00a18928699a tempest-VolumesSnapshotsTestJSON-408362253 tempest-VolumesSnapshotsTestJSON-408362253-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929" status: 404 len: 109 microversion: 2.1 time: 0.037330 Aug 05 20:50:58.627118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 502/978] 10.222.0.100 () {58 vars in 1250 bytes} [Fri Aug 5 20:50:58 2022] GET /compute/v2.1/os-volumes/1ca7c0b3-1fef-4dff-95d3-916e69f59929 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:58.930060 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e62ccd62-fd1d-48eb-8890-7691be05e6cc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:58.930627 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-e62ccd62-fd1d-48eb-8890-7691be05e6cc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:58.937605 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e62ccd62-fd1d-48eb-8890-7691be05e6cc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:58.938256 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e62ccd62-fd1d-48eb-8890-7691be05e6cc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:58.938864 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e62ccd62-fd1d-48eb-8890-7691be05e6cc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:58.939586 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e62ccd62-fd1d-48eb-8890-7691be05e6cc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:58.940054 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e62ccd62-fd1d-48eb-8890-7691be05e6cc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:58.940902 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-e62ccd62-fd1d-48eb-8890-7691be05e6cc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:58.954616 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-e62ccd62-fd1d-48eb-8890-7691be05e6cc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] HTTP exception thrown: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e62ccd62-fd1d-48eb-8890-7691be05e6cc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Request method failure captured: Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: DELETE /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 HTTP/1.1 Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEVT2RIo0sOYhrqEh_HYIhCXXgNEIU5O2TrKSb8O78pPQouV0XDBbsdQswVZsYX73wXTNNa6pCEJklCAufLFYW63yx7CPEVZ0Ry2Y0Ikjromqqlux7d4-wF_GlTFyol_iESoMY4-E-LXutqB0V3ogXtBOvhKaWzWfUtI3jvN-kS_PY Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:50:58.956297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:50:58.957966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8b67138a484f481099c562d7e3ca8401", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:58.957966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:58.957966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:58.957966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:58.957966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:58.957966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:50:58.957966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:50:58.957966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 8e1baad75342476aa0c64bda0414e334 Aug 05 20:50:58.957966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:58.957966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:50:58.957966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:50:58.957966 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': 'c086ce48-8e37-432f-ab19-e87c53936473'} Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:58.958875 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:50:58.960388 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:50:58.961876 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-e62ccd62-fd1d-48eb-8890-7691be05e6cc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Returning 404 to user: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:58.962433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-e62ccd62-fd1d-48eb-8890-7691be05e6cc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 404 len: 111 microversion: 2.1 time: 0.037472 Aug 05 20:50:58.966092 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 477/979] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:50:58 2022] DELETE /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:58.971681 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-50af9b8d-7b25-474d-aaf9-f611ae157fcc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:58.972242 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-50af9b8d-7b25-474d-aaf9-f611ae157fcc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] [instance: c086ce48-8e37-432f-ab19-e87c53936473] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:58.980107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-50af9b8d-7b25-474d-aaf9-f611ae157fcc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:58.980596 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-50af9b8d-7b25-474d-aaf9-f611ae157fcc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:58.981031 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-50af9b8d-7b25-474d-aaf9-f611ae157fcc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:58.981733 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-50af9b8d-7b25-474d-aaf9-f611ae157fcc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:58.982209 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-50af9b8d-7b25-474d-aaf9-f611ae157fcc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:58.982629 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-50af9b8d-7b25-474d-aaf9-f611ae157fcc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:58.997665 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-50af9b8d-7b25-474d-aaf9-f611ae157fcc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] HTTP exception thrown: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-50af9b8d-7b25-474d-aaf9-f611ae157fcc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Request method failure captured: Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 HTTP/1.1 Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEVT2RIo0sOYhrqEh_HYIhCXXgNEIU5O2TrKSb8O78pPQouV0XDBbsdQswVZsYX73wXTNNa6pCEJklCAufLFYW63yx7CPEVZ0Ry2Y0Ikjromqqlux7d4-wF_GlTFyol_iESoMY4-E-LXutqB0V3ogXtBOvhKaWzWfUtI3jvN-kS_PY Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:50:58.999204 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:50:59.000942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/8b67138a484f481099c562d7e3ca8401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_8b67138a484f481099c562d7e3ca8401", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:50:59.000942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:59.000942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 8b67138a484f481099c562d7e3ca8401 Aug 05 20:50:59.000942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-574945107 Aug 05 20:50:59.000942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:59.000942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:50:59.000942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:50:59.000942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 8e1baad75342476aa0c64bda0414e334 Aug 05 20:50:59.000942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeNegativeTest-574945107-project Aug 05 20:50:59.000942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:50:59.000942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:50:59.000942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': 'c086ce48-8e37-432f-ab19-e87c53936473'} Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:50:59.001839 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. Aug 05 20:50:59.003296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:50:59.004635 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-50af9b8d-7b25-474d-aaf9-f611ae157fcc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] Returning 404 to user: Instance c086ce48-8e37-432f-ab19-e87c53936473 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:50:59.004635 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-50af9b8d-7b25-474d-aaf9-f611ae157fcc tempest-AttachVolumeNegativeTest-574945107 tempest-AttachVolumeNegativeTest-574945107-project] 10.222.0.100 "GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473" status: 404 len: 111 microversion: 2.1 time: 0.033265 Aug 05 20:50:59.004635 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 503/980] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:58 2022] GET /compute/v2.1/servers/c086ce48-8e37-432f-ab19-e87c53936473 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:50:59.282840 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-31566377-3a11-4df2-8f64-1c1ea4efbb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:50:59.283913 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-31566377-3a11-4df2-8f64-1c1ea4efbb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:50:59.290371 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-31566377-3a11-4df2-8f64-1c1ea4efbb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:59.290873 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-31566377-3a11-4df2-8f64-1c1ea4efbb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:59.291310 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-31566377-3a11-4df2-8f64-1c1ea4efbb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:59.292277 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-31566377-3a11-4df2-8f64-1c1ea4efbb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:50:59.292734 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-31566377-3a11-4df2-8f64-1c1ea4efbb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:50:59.293362 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-31566377-3a11-4df2-8f64-1c1ea4efbb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:50:59.798247 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-31566377-3a11-4df2-8f64-1c1ea4efbb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:50:59.808789 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-31566377-3a11-4df2-8f64-1c1ea4efbb01 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1269 microversion: 2.1 time: 0.530948 Aug 05 20:50:59.815861 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 478/981] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:50:59 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1269 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:00.694989 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4cb024cc-3692-46b4-bd78-c77674fce060 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:00.695589 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4cb024cc-3692-46b4-bd78-c77674fce060 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:00.701683 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cb024cc-3692-46b4-bd78-c77674fce060 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:00.702407 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cb024cc-3692-46b4-bd78-c77674fce060 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:00.702565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cb024cc-3692-46b4-bd78-c77674fce060 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:00.704144 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cb024cc-3692-46b4-bd78-c77674fce060 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:00.704144 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cb024cc-3692-46b4-bd78-c77674fce060 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:00.704692 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4cb024cc-3692-46b4-bd78-c77674fce060 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:00.718760 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-4cb024cc-3692-46b4-bd78-c77674fce060 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] HTTP exception thrown: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4cb024cc-3692-46b4-bd78-c77674fce060 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Request method failure captured: Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d HTTP/1.1 Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEXspSy7q1zy4V9Cv4aRjZ03fZpiLNmcRvWN6KVoc09VMqrJcz58m2sy75emj-7EcDSb3hAjyBesDI93PKpt5EBFfPqLmGvPDhB5mO2IRQ6FL-vUjtGnRYiVrh_KI_n6qQumKkNVwxY2tokLdVj7j-H0EthC5kOK1UwqZTHvtjW1gs Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 2ae12b8f8a7f40758ca0edaeea7022ab Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:51:00.720957 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:51:00.722565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2ae12b8f8a7f40758ca0edaeea7022ab", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:51:00.722565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:51:00.722565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 2ae12b8f8a7f40758ca0edaeea7022ab Aug 05 20:51:00.722565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:51:00.722565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeTestJSON-1543654885-project Aug 05 20:51:00.722565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:51:00.722565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:51:00.722565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 396a79cbb4e9494791422713c596bc0c Aug 05 20:51:00.722565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeTestJSON-1543654885-project Aug 05 20:51:00.722565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:51:00.722565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:51:00.722565 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '0b095014-137c-4100-a4a2-69023e2cd17d'} Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:51:00.723527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:51:00.725048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:00.728465 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4cb024cc-3692-46b4-bd78-c77674fce060 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Returning 404 to user: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:51:00.728465 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4cb024cc-3692-46b4-bd78-c77674fce060 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 404 len: 111 microversion: 2.1 time: 0.031349 Aug 05 20:51:00.728465 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 504/982] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:51:00 2022] DELETE /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:51:00.734899 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1b9925cd-cbe1-4666-81ab-6b94ce72c727 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:00.735671 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-1b9925cd-cbe1-4666-81ab-6b94ce72c727 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 0b095014-137c-4100-a4a2-69023e2cd17d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:00.742349 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1b9925cd-cbe1-4666-81ab-6b94ce72c727 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:00.743128 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1b9925cd-cbe1-4666-81ab-6b94ce72c727 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:00.743675 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1b9925cd-cbe1-4666-81ab-6b94ce72c727 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:00.744387 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1b9925cd-cbe1-4666-81ab-6b94ce72c727 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:00.744850 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1b9925cd-cbe1-4666-81ab-6b94ce72c727 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:00.745282 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1b9925cd-cbe1-4666-81ab-6b94ce72c727 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:00.760113 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-1b9925cd-cbe1-4666-81ab-6b94ce72c727 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] HTTP exception thrown: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1b9925cd-cbe1-4666-81ab-6b94ce72c727 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Request method failure captured: Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d HTTP/1.1 Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEXspSy7q1zy4V9Cv4aRjZ03fZpiLNmcRvWN6KVoc09VMqrJcz58m2sy75emj-7EcDSb3hAjyBesDI93PKpt5EBFfPqLmGvPDhB5mO2IRQ6FL-vUjtGnRYiVrh_KI_n6qQumKkNVwxY2tokLdVj7j-H0EthC5kOK1UwqZTHvtjW1gs Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 2ae12b8f8a7f40758ca0edaeea7022ab Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:51:00.761682 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:51:00.763031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2ae12b8f8a7f40758ca0edaeea7022ab", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:51:00.763031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:51:00.763031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 2ae12b8f8a7f40758ca0edaeea7022ab Aug 05 20:51:00.763031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:51:00.763031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-AttachVolumeTestJSON-1543654885-project Aug 05 20:51:00.763031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:51:00.763031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:51:00.763031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 396a79cbb4e9494791422713c596bc0c Aug 05 20:51:00.763031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-AttachVolumeTestJSON-1543654885-project Aug 05 20:51:00.763031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:51:00.763031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:51:00.763031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '0b095014-137c-4100-a4a2-69023e2cd17d'} Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:51:00.763808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. Aug 05 20:51:00.766248 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:00.768307 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1b9925cd-cbe1-4666-81ab-6b94ce72c727 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Returning 404 to user: Instance 0b095014-137c-4100-a4a2-69023e2cd17d could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:51:00.768307 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-1b9925cd-cbe1-4666-81ab-6b94ce72c727 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d" status: 404 len: 111 microversion: 2.1 time: 0.033202 Aug 05 20:51:00.768307 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 479/983] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:00 2022] GET /compute/v2.1/servers/0b095014-137c-4100-a4a2-69023e2cd17d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:51:00.833536 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d882cf2d-c902-44c6-b82d-a9e443df4c6e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:00.834577 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d882cf2d-c902-44c6-b82d-a9e443df4c6e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:00.843106 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d882cf2d-c902-44c6-b82d-a9e443df4c6e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:00.843939 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d882cf2d-c902-44c6-b82d-a9e443df4c6e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:00.844853 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d882cf2d-c902-44c6-b82d-a9e443df4c6e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:00.845723 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d882cf2d-c902-44c6-b82d-a9e443df4c6e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:00.847153 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d882cf2d-c902-44c6-b82d-a9e443df4c6e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:00.847769 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d882cf2d-c902-44c6-b82d-a9e443df4c6e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:01.040320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d882cf2d-c902-44c6-b82d-a9e443df4c6e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:01.051534 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d882cf2d-c902-44c6-b82d-a9e443df4c6e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1269 microversion: 2.1 time: 0.221404 Aug 05 20:51:01.052598 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 505/984] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:00 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1269 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:01.958349 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0b35b241-7976-4afd-a621-bb78d5096b4c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:01.959485 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0b35b241-7976-4afd-a621-bb78d5096b4c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:01.967724 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b35b241-7976-4afd-a621-bb78d5096b4c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:01.968257 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b35b241-7976-4afd-a621-bb78d5096b4c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:01.968754 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b35b241-7976-4afd-a621-bb78d5096b4c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:01.969634 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b35b241-7976-4afd-a621-bb78d5096b4c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:01.970100 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b35b241-7976-4afd-a621-bb78d5096b4c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:01.970663 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0b35b241-7976-4afd-a621-bb78d5096b4c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:01.986015 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-0b35b241-7976-4afd-a621-bb78d5096b4c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] HTTP exception thrown: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0b35b241-7976-4afd-a621-bb78d5096b4c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Request method failure captured: Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: DELETE /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd HTTP/1.1 Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEXspSy7q1zy4V9Cv4aRjZ03fZpiLNmcRvWN6KVoc09VMqrJcz58m2sy75emj-7EcDSb3hAjyBesDI93PKpt5EBFfPqLmGvPDhB5mO2IRQ6FL-vUjtGnRYiVrh_KI_n6qQumKkNVwxY2tokLdVj7j-H0EthC5kOK1UwqZTHvtjW1gs Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 2ae12b8f8a7f40758ca0edaeea7022ab Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:51:01.988059 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:51:01.989757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2ae12b8f8a7f40758ca0edaeea7022ab", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:51:01.989757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:51:01.989757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 2ae12b8f8a7f40758ca0edaeea7022ab Aug 05 20:51:01.989757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:51:01.989757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-AttachVolumeTestJSON-1543654885-project Aug 05 20:51:01.989757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:51:01.989757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:51:01.989757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 396a79cbb4e9494791422713c596bc0c Aug 05 20:51:01.989757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-AttachVolumeTestJSON-1543654885-project Aug 05 20:51:01.989757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:51:01.989757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:51:01.989757 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '39afe8dc-01f2-4947-b48c-ac9664fb46cd'} Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:51:01.990662 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:51:01.992163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:01.994253 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0b35b241-7976-4afd-a621-bb78d5096b4c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Returning 404 to user: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:51:01.995166 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0b35b241-7976-4afd-a621-bb78d5096b4c tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "DELETE /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 404 len: 111 microversion: 2.1 time: 0.041596 Aug 05 20:51:01.995769 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 480/985] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:51:01 2022] DELETE /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:51:02.005857 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0b5a9559-34ae-4a82-9c94-aa99ca8b2b49 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:02.006785 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-0b5a9559-34ae-4a82-9c94-aa99ca8b2b49 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] [instance: 39afe8dc-01f2-4947-b48c-ac9664fb46cd] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:02.015229 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b5a9559-34ae-4a82-9c94-aa99ca8b2b49 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:02.018707 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b5a9559-34ae-4a82-9c94-aa99ca8b2b49 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:02.019285 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b5a9559-34ae-4a82-9c94-aa99ca8b2b49 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:02.020128 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b5a9559-34ae-4a82-9c94-aa99ca8b2b49 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:02.020662 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b5a9559-34ae-4a82-9c94-aa99ca8b2b49 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:02.021283 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-0b5a9559-34ae-4a82-9c94-aa99ca8b2b49 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:02.041330 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-0b5a9559-34ae-4a82-9c94-aa99ca8b2b49 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] HTTP exception thrown: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0b5a9559-34ae-4a82-9c94-aa99ca8b2b49 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Request method failure captured: Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd HTTP/1.1 Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEXspSy7q1zy4V9Cv4aRjZ03fZpiLNmcRvWN6KVoc09VMqrJcz58m2sy75emj-7EcDSb3hAjyBesDI93PKpt5EBFfPqLmGvPDhB5mO2IRQ6FL-vUjtGnRYiVrh_KI_n6qQumKkNVwxY2tokLdVj7j-H0EthC5kOK1UwqZTHvtjW1gs Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 2ae12b8f8a7f40758ca0edaeea7022ab Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:51:02.044676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:51:02.046268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2ae12b8f8a7f40758ca0edaeea7022ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2ae12b8f8a7f40758ca0edaeea7022ab", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:51:02.046268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:51:02.046268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 2ae12b8f8a7f40758ca0edaeea7022ab Aug 05 20:51:02.046268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1543654885 Aug 05 20:51:02.046268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeTestJSON-1543654885-project Aug 05 20:51:02.046268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:51:02.046268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:51:02.046268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 396a79cbb4e9494791422713c596bc0c Aug 05 20:51:02.046268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeTestJSON-1543654885-project Aug 05 20:51:02.046268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:51:02.046268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:51:02.046268 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '39afe8dc-01f2-4947-b48c-ac9664fb46cd'} Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:51:02.047203 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. Aug 05 20:51:02.049151 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:02.051442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-0b5a9559-34ae-4a82-9c94-aa99ca8b2b49 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] Returning 404 to user: Instance 39afe8dc-01f2-4947-b48c-ac9664fb46cd could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:51:02.060960 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-0b5a9559-34ae-4a82-9c94-aa99ca8b2b49 tempest-AttachVolumeTestJSON-1543654885 tempest-AttachVolumeTestJSON-1543654885-project] 10.222.0.100 "GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd" status: 404 len: 111 microversion: 2.1 time: 0.060586 Aug 05 20:51:02.063421 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 506/986] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:01 2022] GET /compute/v2.1/servers/39afe8dc-01f2-4947-b48c-ac9664fb46cd => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 20:51:02.081874 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-287ec144-cd40-4b0f-8f0a-171621c2dc8b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:02.082497 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-287ec144-cd40-4b0f-8f0a-171621c2dc8b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:02.089525 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-287ec144-cd40-4b0f-8f0a-171621c2dc8b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:02.090018 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-287ec144-cd40-4b0f-8f0a-171621c2dc8b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:02.090458 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-287ec144-cd40-4b0f-8f0a-171621c2dc8b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:02.091180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-287ec144-cd40-4b0f-8f0a-171621c2dc8b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:02.091692 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-287ec144-cd40-4b0f-8f0a-171621c2dc8b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:02.092180 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-287ec144-cd40-4b0f-8f0a-171621c2dc8b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:02.361729 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-287ec144-cd40-4b0f-8f0a-171621c2dc8b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:02.374698 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-287ec144-cd40-4b0f-8f0a-171621c2dc8b tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1269 microversion: 2.1 time: 0.297443 Aug 05 20:51:02.379727 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 481/987] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:02 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1269 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:03.401837 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-7955b711-b16b-4ef3-9da9-74dee463c717 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:03.403793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-7955b711-b16b-4ef3-9da9-74dee463c717 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:03.432637 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7955b711-b16b-4ef3-9da9-74dee463c717 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:03.434181 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7955b711-b16b-4ef3-9da9-74dee463c717 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:03.434612 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7955b711-b16b-4ef3-9da9-74dee463c717 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:03.435343 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7955b711-b16b-4ef3-9da9-74dee463c717 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:03.435826 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7955b711-b16b-4ef3-9da9-74dee463c717 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:03.436246 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-7955b711-b16b-4ef3-9da9-74dee463c717 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:03.596315 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-7955b711-b16b-4ef3-9da9-74dee463c717 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:03.606660 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-7955b711-b16b-4ef3-9da9-74dee463c717 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1269 microversion: 2.1 time: 0.210277 Aug 05 20:51:03.607389 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 507/988] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:03 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1269 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:04.628288 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ad0e2c37-9cc7-4263-878c-9765fcab9091 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:04.629576 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ad0e2c37-9cc7-4263-878c-9765fcab9091 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:04.644983 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad0e2c37-9cc7-4263-878c-9765fcab9091 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:04.645788 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad0e2c37-9cc7-4263-878c-9765fcab9091 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:04.646498 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad0e2c37-9cc7-4263-878c-9765fcab9091 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:04.651627 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad0e2c37-9cc7-4263-878c-9765fcab9091 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:04.653715 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad0e2c37-9cc7-4263-878c-9765fcab9091 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:04.654881 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad0e2c37-9cc7-4263-878c-9765fcab9091 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:05.010709 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-ad0e2c37-9cc7-4263-878c-9765fcab9091 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:05.019243 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ad0e2c37-9cc7-4263-878c-9765fcab9091 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1269 microversion: 2.1 time: 0.395958 Aug 05 20:51:05.020614 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 482/989] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:04 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1269 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:06.042786 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-951c0143-c3e8-4e45-8782-156113656cd6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:06.044066 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-951c0143-c3e8-4e45-8782-156113656cd6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:06.053017 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951c0143-c3e8-4e45-8782-156113656cd6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:06.054624 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951c0143-c3e8-4e45-8782-156113656cd6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:06.056605 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951c0143-c3e8-4e45-8782-156113656cd6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:06.060221 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951c0143-c3e8-4e45-8782-156113656cd6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:06.060699 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951c0143-c3e8-4e45-8782-156113656cd6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:06.061124 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-951c0143-c3e8-4e45-8782-156113656cd6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:06.285983 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-951c0143-c3e8-4e45-8782-156113656cd6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:06.302121 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-951c0143-c3e8-4e45-8782-156113656cd6 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1269 microversion: 2.1 time: 0.262100 Aug 05 20:51:06.303185 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 508/990] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:06 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1269 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:06.319448 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-f6eea714-4dc8-491b-9d2f-2d0481b12d51 req-e1ad0ba4-8c1b-4fd1-84f6-00b564cfee28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce647114-7b2b-4ed1-94c2-93f5f7dface7", "name": "network-vif-plugged", "status": "completed", "tag": "ac1f9a37-2bdf-419a-83fe-c50df645c906"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:51:06.363449 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-f6eea714-4dc8-491b-9d2f-2d0481b12d51 req-e1ad0ba4-8c1b-4fd1-84f6-00b564cfee28 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:06.364375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-f6eea714-4dc8-491b-9d2f-2d0481b12d51 req-e1ad0ba4-8c1b-4fd1-84f6-00b564cfee28 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:06.365632 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-f6eea714-4dc8-491b-9d2f-2d0481b12d51 req-e1ad0ba4-8c1b-4fd1-84f6-00b564cfee28 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:06.400259 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-f6eea714-4dc8-491b-9d2f-2d0481b12d51 req-e1ad0ba4-8c1b-4fd1-84f6-00b564cfee28 service nova] Creating event network-vif-plugged:ac1f9a37-2bdf-419a-83fe-c50df645c906 for instance ce647114-7b2b-4ed1-94c2-93f5f7dface7 on hv-cinder-85220 Aug 05 20:51:06.409199 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-f6eea714-4dc8-491b-9d2f-2d0481b12d51 req-e1ad0ba4-8c1b-4fd1-84f6-00b564cfee28 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097466 Aug 05 20:51:06.409819 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 483/991] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:51:07.325260 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1d0a0e96-c82e-47e0-a917-7e34249a0a16 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:07.326599 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1d0a0e96-c82e-47e0-a917-7e34249a0a16 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:07.333775 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d0a0e96-c82e-47e0-a917-7e34249a0a16 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:07.334446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d0a0e96-c82e-47e0-a917-7e34249a0a16 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:07.335057 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d0a0e96-c82e-47e0-a917-7e34249a0a16 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:07.336032 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d0a0e96-c82e-47e0-a917-7e34249a0a16 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:07.336647 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d0a0e96-c82e-47e0-a917-7e34249a0a16 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:07.337451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1d0a0e96-c82e-47e0-a917-7e34249a0a16 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:07.526530 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-1d0a0e96-c82e-47e0-a917-7e34249a0a16 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:07.535489 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1d0a0e96-c82e-47e0-a917-7e34249a0a16 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1269 microversion: 2.1 time: 0.214651 Aug 05 20:51:07.536137 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 509/992] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:07 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1269 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:08.561935 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0063a7c9-212c-4c76-b14c-6625a11c590f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:08.563474 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-0063a7c9-212c-4c76-b14c-6625a11c590f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:08.590557 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0063a7c9-212c-4c76-b14c-6625a11c590f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:08.591063 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0063a7c9-212c-4c76-b14c-6625a11c590f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:08.591710 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0063a7c9-212c-4c76-b14c-6625a11c590f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:08.592469 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0063a7c9-212c-4c76-b14c-6625a11c590f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:08.593601 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0063a7c9-212c-4c76-b14c-6625a11c590f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:08.594520 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-0063a7c9-212c-4c76-b14c-6625a11c590f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:08.803196 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-0063a7c9-212c-4c76-b14c-6625a11c590f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:08.814864 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0063a7c9-212c-4c76-b14c-6625a11c590f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1456 microversion: 2.1 time: 0.259050 Aug 05 20:51:08.816406 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 484/993] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:08 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1456 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:08.840206 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fb1267a1-8657-4517-b27e-3ac1e00f121e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:08.841098 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fb1267a1-8657-4517-b27e-3ac1e00f121e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:08.843480 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:08.849682 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb1267a1-8657-4517-b27e-3ac1e00f121e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:08.850404 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb1267a1-8657-4517-b27e-3ac1e00f121e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:08.852084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb1267a1-8657-4517-b27e-3ac1e00f121e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:08.853616 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb1267a1-8657-4517-b27e-3ac1e00f121e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:08.854453 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb1267a1-8657-4517-b27e-3ac1e00f121e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:08.855208 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb1267a1-8657-4517-b27e-3ac1e00f121e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:09.048981 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fb1267a1-8657-4517-b27e-3ac1e00f121e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:09.054951 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=100 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:09.059494 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fb1267a1-8657-4517-b27e-3ac1e00f121e tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1456 microversion: 2.1 time: 0.223073 Aug 05 20:51:09.060278 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 510/994] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:08 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1456 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:11.323135 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-5cdf7209-f82d-472a-8b6e-36b60b3cb614 req-1fa1771b-7256-4073-9412-62bab5c9175a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce647114-7b2b-4ed1-94c2-93f5f7dface7", "tag": "ac1f9a37-2bdf-419a-83fe-c50df645c906"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:51:11.333865 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-5cdf7209-f82d-472a-8b6e-36b60b3cb614 req-1fa1771b-7256-4073-9412-62bab5c9175a service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:11.334689 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-5cdf7209-f82d-472a-8b6e-36b60b3cb614 req-1fa1771b-7256-4073-9412-62bab5c9175a service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:11.335339 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-5cdf7209-f82d-472a-8b6e-36b60b3cb614 req-1fa1771b-7256-4073-9412-62bab5c9175a service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:11.347095 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-5cdf7209-f82d-472a-8b6e-36b60b3cb614 req-1fa1771b-7256-4073-9412-62bab5c9175a service nova] Creating event network-changed:ac1f9a37-2bdf-419a-83fe-c50df645c906 for instance ce647114-7b2b-4ed1-94c2-93f5f7dface7 on hv-cinder-85220 Aug 05 20:51:11.353514 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-5cdf7209-f82d-472a-8b6e-36b60b3cb614 req-1fa1771b-7256-4073-9412-62bab5c9175a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034044 Aug 05 20:51:11.354561 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 485/995] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:51:11.647651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6e5cdb9a-4225-4106-ae4a-b7673e7577bb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:11.650890 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6e5cdb9a-4225-4106-ae4a-b7673e7577bb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:11.658442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e5cdb9a-4225-4106-ae4a-b7673e7577bb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:11.659043 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e5cdb9a-4225-4106-ae4a-b7673e7577bb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:11.659791 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e5cdb9a-4225-4106-ae4a-b7673e7577bb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:11.660680 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e5cdb9a-4225-4106-ae4a-b7673e7577bb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:11.661133 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e5cdb9a-4225-4106-ae4a-b7673e7577bb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:11.661720 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6e5cdb9a-4225-4106-ae4a-b7673e7577bb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:11.696180 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6e5cdb9a-4225-4106-ae4a-b7673e7577bb tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052014 Aug 05 20:51:11.697081 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 511/996] 10.222.0.100 () {60 vars in 1348 bytes} [Fri Aug 5 20:51:11 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:11.771766 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-dad5a717-b922-4714-b171-7ed461378771 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:11.772762 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-dad5a717-b922-4714-b171-7ed461378771 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:11.780235 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dad5a717-b922-4714-b171-7ed461378771 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:11.781018 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dad5a717-b922-4714-b171-7ed461378771 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:11.781623 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dad5a717-b922-4714-b171-7ed461378771 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:11.782503 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dad5a717-b922-4714-b171-7ed461378771 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:11.783129 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dad5a717-b922-4714-b171-7ed461378771 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:11.783589 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-dad5a717-b922-4714-b171-7ed461378771 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:11.840804 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-dad5a717-b922-4714-b171-7ed461378771 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Going to try to terminate instance {{(pid=124431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:51:11.959127 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-dad5a717-b922-4714-b171-7ed461378771 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "DELETE /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 204 len: 0 microversion: 2.20 time: 0.191779 Aug 05 20:51:11.960141 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 486/997] 10.222.0.100 () {60 vars in 1285 bytes} [Fri Aug 5 20:51:11 2022] DELETE /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 20:51:11.968891 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c2eac0ce-fca7-430f-b765-08d502d7124b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:11.970030 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c2eac0ce-fca7-430f-b765-08d502d7124b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:11.977280 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2eac0ce-fca7-430f-b765-08d502d7124b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:11.978030 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2eac0ce-fca7-430f-b765-08d502d7124b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:11.978630 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2eac0ce-fca7-430f-b765-08d502d7124b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:11.979530 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2eac0ce-fca7-430f-b765-08d502d7124b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:11.980131 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2eac0ce-fca7-430f-b765-08d502d7124b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:11.980814 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c2eac0ce-fca7-430f-b765-08d502d7124b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:12.149749 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c2eac0ce-fca7-430f-b765-08d502d7124b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:12.162886 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c2eac0ce-fca7-430f-b765-08d502d7124b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:12.164712 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c2eac0ce-fca7-430f-b765-08d502d7124b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:12.166175 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c2eac0ce-fca7-430f-b765-08d502d7124b tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.201530 Aug 05 20:51:12.167255 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 512/998] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:51:11 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:51:13.199402 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-654d9b14-79cc-41d0-95ea-28eaab084480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:13.200611 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-654d9b14-79cc-41d0-95ea-28eaab084480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:13.211686 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-654d9b14-79cc-41d0-95ea-28eaab084480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:13.212502 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-654d9b14-79cc-41d0-95ea-28eaab084480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:13.213237 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-654d9b14-79cc-41d0-95ea-28eaab084480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:13.214383 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-654d9b14-79cc-41d0-95ea-28eaab084480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:13.215139 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-654d9b14-79cc-41d0-95ea-28eaab084480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:13.215897 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-654d9b14-79cc-41d0-95ea-28eaab084480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:13.358481 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-654d9b14-79cc-41d0-95ea-28eaab084480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:13.367253 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-654d9b14-79cc-41d0-95ea-28eaab084480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:13.368818 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-654d9b14-79cc-41d0-95ea-28eaab084480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:13.370038 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-654d9b14-79cc-41d0-95ea-28eaab084480 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.177870 Aug 05 20:51:13.370659 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 487/999] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:51:13 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:51:14.395496 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d44b313d-6072-4aa3-98f7-c375d5c1d346 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:14.396221 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d44b313d-6072-4aa3-98f7-c375d5c1d346 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:14.408790 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d44b313d-6072-4aa3-98f7-c375d5c1d346 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:14.409703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d44b313d-6072-4aa3-98f7-c375d5c1d346 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:14.410629 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d44b313d-6072-4aa3-98f7-c375d5c1d346 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:14.412138 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d44b313d-6072-4aa3-98f7-c375d5c1d346 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:14.413102 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d44b313d-6072-4aa3-98f7-c375d5c1d346 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:14.413973 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d44b313d-6072-4aa3-98f7-c375d5c1d346 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:14.560149 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d44b313d-6072-4aa3-98f7-c375d5c1d346 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:14.569481 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d44b313d-6072-4aa3-98f7-c375d5c1d346 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:14.571035 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d44b313d-6072-4aa3-98f7-c375d5c1d346 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:14.572240 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d44b313d-6072-4aa3-98f7-c375d5c1d346 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.182193 Aug 05 20:51:14.572805 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 513/1000] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:51:14 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:51:15.596344 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-139c99d3-5b2a-468d-a211-6cd6873ae797 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:15.597138 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-139c99d3-5b2a-468d-a211-6cd6873ae797 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:15.604606 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-139c99d3-5b2a-468d-a211-6cd6873ae797 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:15.605370 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-139c99d3-5b2a-468d-a211-6cd6873ae797 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:15.605647 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-139c99d3-5b2a-468d-a211-6cd6873ae797 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:15.606694 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-139c99d3-5b2a-468d-a211-6cd6873ae797 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:15.607225 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-139c99d3-5b2a-468d-a211-6cd6873ae797 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:15.607729 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-139c99d3-5b2a-468d-a211-6cd6873ae797 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:15.749281 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-139c99d3-5b2a-468d-a211-6cd6873ae797 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:15.757515 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-139c99d3-5b2a-468d-a211-6cd6873ae797 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:15.759031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-139c99d3-5b2a-468d-a211-6cd6873ae797 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:15.760273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-139c99d3-5b2a-468d-a211-6cd6873ae797 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.168717 Aug 05 20:51:15.760987 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 488/1001] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:51:15 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:51:16.784057 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-3853811b-3cf1-41a0-b660-6706fb39d057 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:16.784690 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-3853811b-3cf1-41a0-b660-6706fb39d057 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:16.791318 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3853811b-3cf1-41a0-b660-6706fb39d057 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:16.791836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3853811b-3cf1-41a0-b660-6706fb39d057 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:16.792269 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3853811b-3cf1-41a0-b660-6706fb39d057 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:16.792947 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3853811b-3cf1-41a0-b660-6706fb39d057 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:16.793396 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3853811b-3cf1-41a0-b660-6706fb39d057 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:16.793819 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-3853811b-3cf1-41a0-b660-6706fb39d057 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:16.929350 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3853811b-3cf1-41a0-b660-6706fb39d057 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:16.940130 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3853811b-3cf1-41a0-b660-6706fb39d057 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:16.941640 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-3853811b-3cf1-41a0-b660-6706fb39d057 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:16.942819 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-3853811b-3cf1-41a0-b660-6706fb39d057 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.162914 Aug 05 20:51:16.943388 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 514/1002] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:51:16 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:51:17.966047 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-36c147ef-e2f8-4531-8499-6be67473e697 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:17.966664 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-36c147ef-e2f8-4531-8499-6be67473e697 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:17.973560 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36c147ef-e2f8-4531-8499-6be67473e697 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:17.974052 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36c147ef-e2f8-4531-8499-6be67473e697 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:17.974489 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36c147ef-e2f8-4531-8499-6be67473e697 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:17.975187 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36c147ef-e2f8-4531-8499-6be67473e697 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:17.975666 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36c147ef-e2f8-4531-8499-6be67473e697 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:17.976090 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-36c147ef-e2f8-4531-8499-6be67473e697 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:18.120734 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-36c147ef-e2f8-4531-8499-6be67473e697 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:18.129385 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-36c147ef-e2f8-4531-8499-6be67473e697 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:18.130907 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-36c147ef-e2f8-4531-8499-6be67473e697 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:18.132430 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-36c147ef-e2f8-4531-8499-6be67473e697 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1727 microversion: 2.20 time: 0.170374 Aug 05 20:51:18.133014 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 489/1003] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:51:17 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:51:19.157126 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d4848999-bc4f-4abf-8d4f-4519c838a597 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:19.157905 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d4848999-bc4f-4abf-8d4f-4519c838a597 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:19.164890 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d4848999-bc4f-4abf-8d4f-4519c838a597 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:19.165373 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d4848999-bc4f-4abf-8d4f-4519c838a597 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:19.165980 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d4848999-bc4f-4abf-8d4f-4519c838a597 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:19.166683 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d4848999-bc4f-4abf-8d4f-4519c838a597 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:19.167128 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d4848999-bc4f-4abf-8d4f-4519c838a597 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:19.167583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d4848999-bc4f-4abf-8d4f-4519c838a597 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:19.273597 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d4848999-bc4f-4abf-8d4f-4519c838a597 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:19.284815 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d4848999-bc4f-4abf-8d4f-4519c838a597 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:19.284815 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d4848999-bc4f-4abf-8d4f-4519c838a597 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:19.285847 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d4848999-bc4f-4abf-8d4f-4519c838a597 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1660 microversion: 2.20 time: 0.133120 Aug 05 20:51:19.300983 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 515/1004] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:51:19 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1660 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:51:19.513351 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-1c097272-16af-4468-a4ce-aa1395e97d66 req-9ea2d7fc-3fb6-48fe-a5dd-0c6d9e12468b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe498615-6695-4746-89be-48a9e31f6b4d", "name": "network-vif-deleted", "tag": "5596f6df-3385-436f-9183-b31838466a7c"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:51:19.528136 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-1c097272-16af-4468-a4ce-aa1395e97d66 req-9ea2d7fc-3fb6-48fe-a5dd-0c6d9e12468b service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:19.528597 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-1c097272-16af-4468-a4ce-aa1395e97d66 req-9ea2d7fc-3fb6-48fe-a5dd-0c6d9e12468b service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:19.529390 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-1c097272-16af-4468-a4ce-aa1395e97d66 req-9ea2d7fc-3fb6-48fe-a5dd-0c6d9e12468b service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:19.543026 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-1c097272-16af-4468-a4ce-aa1395e97d66 req-9ea2d7fc-3fb6-48fe-a5dd-0c6d9e12468b service nova] Creating event network-vif-deleted:5596f6df-3385-436f-9183-b31838466a7c for instance fe498615-6695-4746-89be-48a9e31f6b4d on hv-cinder-85220 Aug 05 20:51:19.548377 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-1c097272-16af-4468-a4ce-aa1395e97d66 req-9ea2d7fc-3fb6-48fe-a5dd-0c6d9e12468b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038750 Aug 05 20:51:19.549243 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 490/1005] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:51:20.308828 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-43947958-1425-47e9-8520-ca51a980fce1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:20.310120 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-43947958-1425-47e9-8520-ca51a980fce1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:20.317000 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43947958-1425-47e9-8520-ca51a980fce1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:20.317394 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43947958-1425-47e9-8520-ca51a980fce1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:20.317944 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43947958-1425-47e9-8520-ca51a980fce1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:20.318503 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43947958-1425-47e9-8520-ca51a980fce1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:20.318915 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43947958-1425-47e9-8520-ca51a980fce1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:20.319657 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-43947958-1425-47e9-8520-ca51a980fce1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:20.386310 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-43947958-1425-47e9-8520-ca51a980fce1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:20.395527 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-43947958-1425-47e9-8520-ca51a980fce1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:20.396846 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-43947958-1425-47e9-8520-ca51a980fce1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:20.398148 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-43947958-1425-47e9-8520-ca51a980fce1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1660 microversion: 2.20 time: 0.093392 Aug 05 20:51:20.398889 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 516/1006] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:51:20 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1660 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:51:21.423224 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:21.423934 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:21.430580 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:21.431065 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:21.431535 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:21.432219 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:21.432668 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:21.433087 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:21.464703 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:21.465178 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:21.465608 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:21.466054 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lazy-loading 'fault' on Instance uuid fe498615-6695-4746-89be-48a9e31f6b4d {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:51:21.515225 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:21.523399 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:21.524924 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44ac4775be0244df8fa0ee51a765c03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c687166988fc4513a81e536a8f38ca3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:21.526394 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-1e6646ac-c158-4151-90ca-142e1eed799a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 200 len: 1374 microversion: 2.20 time: 0.108529 Aug 05 20:51:21.526942 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 491/1007] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:51:21 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 1374 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 20:51:22.550262 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ca6842e6-20e3-40ed-b48c-54f511a0e373 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:22.551008 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ca6842e6-20e3-40ed-b48c-54f511a0e373 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:22.561710 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ca6842e6-20e3-40ed-b48c-54f511a0e373 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:22.562317 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ca6842e6-20e3-40ed-b48c-54f511a0e373 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:22.562870 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ca6842e6-20e3-40ed-b48c-54f511a0e373 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:22.563618 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ca6842e6-20e3-40ed-b48c-54f511a0e373 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:22.564214 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ca6842e6-20e3-40ed-b48c-54f511a0e373 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:22.564502 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ca6842e6-20e3-40ed-b48c-54f511a0e373 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:22.580141 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-ca6842e6-20e3-40ed-b48c-54f511a0e373 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] HTTP exception thrown: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ca6842e6-20e3-40ed-b48c-54f511a0e373 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Request method failure captured: Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d HTTP/1.1 Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEbEos-a63yYE10LSxbaZ_GRvUCy-6JJASVZ5x3f_X1bLptZYaYiPBkmkEzRN-MYzWNYpnwiFVJOXeveS6I0YUTfVTpppEonWUed-QlUFlFp861h98w2GS1mHfgZfmRu5w0mGmSkPevFOiV9wvhwaZN0T3LPfyvm6G1WhNbq86EvOc Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: c687166988fc4513a81e536a8f38ca3e Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:51:22.582007 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:51:22.583887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_c687166988fc4513a81e536a8f38ca3e", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:51:22.583887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:22.583887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: c687166988fc4513a81e536a8f38ca3e Aug 05 20:51:22.583887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:22.583887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeShelveTestJSON-411590550-project Aug 05 20:51:22.583887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:51:22.583887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:51:22.583887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 44ac4775be0244df8fa0ee51a765c03a Aug 05 20:51:22.583887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeShelveTestJSON-411590550-project Aug 05 20:51:22.583887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:51:22.583887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:22.583887 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': 'fe498615-6695-4746-89be-48a9e31f6b4d'} Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:51:22.584836 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:22.586409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:22.588344 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ca6842e6-20e3-40ed-b48c-54f511a0e373 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Returning 404 to user: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:51:22.588344 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ca6842e6-20e3-40ed-b48c-54f511a0e373 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 404 len: 111 microversion: 2.20 time: 0.037844 Aug 05 20:51:22.588344 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 517/1008] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:51:22 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:51:22.595847 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-0f453645-4608-48ce-b256-30d1be637ecc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '.version_select at 0x7f9be76f89d0>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:22.618925 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-0f453645-4608-48ce-b256-30d1be637ecc tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-462310245" status: 204 len: 0 microversion: 2.20 time: 0.027202 Aug 05 20:51:22.620616 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 492/1009] 10.222.0.100 () {60 vars in 1264 bytes} [Fri Aug 5 20:51:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-462310245 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 20:51:24.523562 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6fcbd411-bf2b-4d40-8c3f-b5257a282f77 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:24.524303 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-6fcbd411-bf2b-4d40-8c3f-b5257a282f77 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:24.531409 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6fcbd411-bf2b-4d40-8c3f-b5257a282f77 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:24.532105 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6fcbd411-bf2b-4d40-8c3f-b5257a282f77 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:24.532781 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6fcbd411-bf2b-4d40-8c3f-b5257a282f77 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:24.533563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6fcbd411-bf2b-4d40-8c3f-b5257a282f77 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:24.534086 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6fcbd411-bf2b-4d40-8c3f-b5257a282f77 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:24.534647 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-6fcbd411-bf2b-4d40-8c3f-b5257a282f77 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:24.551484 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-6fcbd411-bf2b-4d40-8c3f-b5257a282f77 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] HTTP exception thrown: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6fcbd411-bf2b-4d40-8c3f-b5257a282f77 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Request method failure captured: Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d HTTP/1.1 Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEbEos-a63yYE10LSxbaZ_GRvUCy-6JJASVZ5x3f_X1bLptZYaYiPBkmkEzRN-MYzWNYpnwiFVJOXeveS6I0YUTfVTpppEonWUed-QlUFlFp861h98w2GS1mHfgZfmRu5w0mGmSkPevFOiV9wvhwaZN0T3LPfyvm6G1WhNbq86EvOc Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: c687166988fc4513a81e536a8f38ca3e Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:51:24.553378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:51:24.555103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_c687166988fc4513a81e536a8f38ca3e", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:51:24.555103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:24.555103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: c687166988fc4513a81e536a8f38ca3e Aug 05 20:51:24.555103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:24.555103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeShelveTestJSON-411590550-project Aug 05 20:51:24.555103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:51:24.555103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:51:24.555103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 44ac4775be0244df8fa0ee51a765c03a Aug 05 20:51:24.555103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeShelveTestJSON-411590550-project Aug 05 20:51:24.555103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:51:24.555103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:24.555103 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': 'fe498615-6695-4746-89be-48a9e31f6b4d'} Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:51:24.556054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:24.557542 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:24.559065 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-6fcbd411-bf2b-4d40-8c3f-b5257a282f77 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Returning 404 to user: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:51:24.559065 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-6fcbd411-bf2b-4d40-8c3f-b5257a282f77 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "DELETE /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 404 len: 111 microversion: 2.20 time: 0.036031 Aug 05 20:51:24.559065 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 518/1010] 10.222.0.100 () {60 vars in 1285 bytes} [Fri Aug 5 20:51:24 2022] DELETE /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:51:24.568681 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-035d3be9-ff89-422b-b344-ba6ae979e444 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:24.569518 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-035d3be9-ff89-422b-b344-ba6ae979e444 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: fe498615-6695-4746-89be-48a9e31f6b4d] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:24.582943 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-035d3be9-ff89-422b-b344-ba6ae979e444 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:24.583763 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-035d3be9-ff89-422b-b344-ba6ae979e444 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:24.584288 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-035d3be9-ff89-422b-b344-ba6ae979e444 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:24.585135 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-035d3be9-ff89-422b-b344-ba6ae979e444 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:24.585661 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-035d3be9-ff89-422b-b344-ba6ae979e444 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:24.586190 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-035d3be9-ff89-422b-b344-ba6ae979e444 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:24.607247 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-035d3be9-ff89-422b-b344-ba6ae979e444 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] HTTP exception thrown: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-035d3be9-ff89-422b-b344-ba6ae979e444 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Request method failure captured: Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d HTTP/1.1 Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEbEos-a63yYE10LSxbaZ_GRvUCy-6JJASVZ5x3f_X1bLptZYaYiPBkmkEzRN-MYzWNYpnwiFVJOXeveS6I0YUTfVTpppEonWUed-QlUFlFp861h98w2GS1mHfgZfmRu5w0mGmSkPevFOiV9wvhwaZN0T3LPfyvm6G1WhNbq86EvOc Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: c687166988fc4513a81e536a8f38ca3e Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:51:24.609112 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:51:24.610817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_c687166988fc4513a81e536a8f38ca3e", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:51:24.610817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:24.610817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: c687166988fc4513a81e536a8f38ca3e Aug 05 20:51:24.610817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:24.610817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-AttachVolumeShelveTestJSON-411590550-project Aug 05 20:51:24.610817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:51:24.610817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:51:24.610817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 44ac4775be0244df8fa0ee51a765c03a Aug 05 20:51:24.610817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-AttachVolumeShelveTestJSON-411590550-project Aug 05 20:51:24.610817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:51:24.610817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:24.610817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': 'fe498615-6695-4746-89be-48a9e31f6b4d'} Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:51:24.612144 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. Aug 05 20:51:24.613625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:24.615470 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-035d3be9-ff89-422b-b344-ba6ae979e444 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Returning 404 to user: Instance fe498615-6695-4746-89be-48a9e31f6b4d could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:51:24.615470 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-035d3be9-ff89-422b-b344-ba6ae979e444 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d" status: 404 len: 111 microversion: 2.20 time: 0.046179 Aug 05 20:51:24.615470 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 493/1011] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:51:24 2022] GET /compute/v2.1/servers/fe498615-6695-4746-89be-48a9e31f6b4d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:51:27.903219 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-da722897-5d79-4705-b6f5-c67a5cb86c9a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:27.905580 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-da722897-5d79-4705-b6f5-c67a5cb86c9a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:27.924807 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da722897-5d79-4705-b6f5-c67a5cb86c9a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:27.925321 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da722897-5d79-4705-b6f5-c67a5cb86c9a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:27.925766 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da722897-5d79-4705-b6f5-c67a5cb86c9a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:27.927241 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da722897-5d79-4705-b6f5-c67a5cb86c9a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:27.927739 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da722897-5d79-4705-b6f5-c67a5cb86c9a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:27.928175 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-da722897-5d79-4705-b6f5-c67a5cb86c9a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:27.944337 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-da722897-5d79-4705-b6f5-c67a5cb86c9a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] HTTP exception thrown: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-da722897-5d79-4705-b6f5-c67a5cb86c9a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Request method failure captured: Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: DELETE /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 HTTP/1.1 Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YEbEos-a63yYE10LSxbaZ_GRvUCy-6JJASVZ5x3f_X1bLptZYaYiPBkmkEzRN-MYzWNYpnwiFVJOXeveS6I0YUTfVTpppEonWUed-QlUFlFp861h98w2GS1mHfgZfmRu5w0mGmSkPevFOiV9wvhwaZN0T3LPfyvm6G1WhNbq86EvOc Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: c687166988fc4513a81e536a8f38ca3e Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:51:27.945961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:51:27.949455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_c687166988fc4513a81e536a8f38ca3e", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:51:27.949455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:27.949455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: c687166988fc4513a81e536a8f38ca3e Aug 05 20:51:27.949455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:27.949455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-AttachVolumeShelveTestJSON-411590550-project Aug 05 20:51:27.949455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:51:27.949455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:51:27.949455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 44ac4775be0244df8fa0ee51a765c03a Aug 05 20:51:27.949455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-AttachVolumeShelveTestJSON-411590550-project Aug 05 20:51:27.949455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:51:27.949455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:51:27.949455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '20537f07-e2b8-4c88-8757-58c0b37570d2'} Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:51:27.951275 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:51:27.953932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:27.958015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-da722897-5d79-4705-b6f5-c67a5cb86c9a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Returning 404 to user: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:51:27.958015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-da722897-5d79-4705-b6f5-c67a5cb86c9a tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "DELETE /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 404 len: 111 microversion: 2.20 time: 0.049801 Aug 05 20:51:27.960119 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-54ed3c76-0d3c-4d16-8a9e-acdabed110b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:27.961297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-54ed3c76-0d3c-4d16-8a9e-acdabed110b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] [instance: 20537f07-e2b8-4c88-8757-58c0b37570d2] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:27.963447 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 519/1012] 10.222.0.100 () {60 vars in 1285 bytes} [Fri Aug 5 20:51:27 2022] DELETE /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 20:51:27.968223 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54ed3c76-0d3c-4d16-8a9e-acdabed110b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:27.968729 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54ed3c76-0d3c-4d16-8a9e-acdabed110b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:27.969326 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54ed3c76-0d3c-4d16-8a9e-acdabed110b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:27.970420 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54ed3c76-0d3c-4d16-8a9e-acdabed110b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:27.973020 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54ed3c76-0d3c-4d16-8a9e-acdabed110b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:27.973020 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-54ed3c76-0d3c-4d16-8a9e-acdabed110b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:27.976542 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:27.987517 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-54ed3c76-0d3c-4d16-8a9e-acdabed110b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] HTTP exception thrown: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-54ed3c76-0d3c-4d16-8a9e-acdabed110b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Request method failure captured: Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 HTTP/1.1 Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YEbEos-a63yYE10LSxbaZ_GRvUCy-6JJASVZ5x3f_X1bLptZYaYiPBkmkEzRN-MYzWNYpnwiFVJOXeveS6I0YUTfVTpppEonWUed-QlUFlFp861h98w2GS1mHfgZfmRu5w0mGmSkPevFOiV9wvhwaZN0T3LPfyvm6G1WhNbq86EvOc Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: c687166988fc4513a81e536a8f38ca3e Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:51:27.989441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:51:27.992376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c687166988fc4513a81e536a8f38ca3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_c687166988fc4513a81e536a8f38ca3e", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:51:27.992376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:27.992376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: c687166988fc4513a81e536a8f38ca3e Aug 05 20:51:27.992376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-411590550 Aug 05 20:51:27.992376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-AttachVolumeShelveTestJSON-411590550-project Aug 05 20:51:27.992376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:51:27.992376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:51:27.992376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 44ac4775be0244df8fa0ee51a765c03a Aug 05 20:51:27.992376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-AttachVolumeShelveTestJSON-411590550-project Aug 05 20:51:27.992376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:51:27.992376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:51:27.992376 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '20537f07-e2b8-4c88-8757-58c0b37570d2'} Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:51:27.994530 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. Aug 05 20:51:27.998975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:51:28.001016 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-54ed3c76-0d3c-4d16-8a9e-acdabed110b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] Returning 404 to user: Instance 20537f07-e2b8-4c88-8757-58c0b37570d2 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:51:28.001016 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-54ed3c76-0d3c-4d16-8a9e-acdabed110b1 tempest-AttachVolumeShelveTestJSON-411590550 tempest-AttachVolumeShelveTestJSON-411590550-project] 10.222.0.100 "GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2" status: 404 len: 111 microversion: 2.20 time: 0.037605 Aug 05 20:51:28.001016 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 494/1013] 10.222.0.100 () {60 vars in 1282 bytes} [Fri Aug 5 20:51:27 2022] GET /compute/v2.1/servers/20537f07-e2b8-4c88-8757-58c0b37570d2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 05 20:51:34.177035 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fcdc1a15-e93c-4ffa-a90a-9f850ad99b11 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:34.177562 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fcdc1a15-e93c-4ffa-a90a-9f850ad99b11 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:34.179640 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-f0ce0451-556c-49c8-96cf-f2f7da3bd92b req-a0540380-f80f-467d-8e96-07189805cf38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12ad125-6f29-4ee3-971f-d1c23391c89f", "tag": "aca05bcd-9297-4365-a6e9-dca538228f87"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:51:34.184942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fcdc1a15-e93c-4ffa-a90a-9f850ad99b11 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:34.185701 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fcdc1a15-e93c-4ffa-a90a-9f850ad99b11 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:34.186809 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fcdc1a15-e93c-4ffa-a90a-9f850ad99b11 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:34.187783 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fcdc1a15-e93c-4ffa-a90a-9f850ad99b11 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:34.188710 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fcdc1a15-e93c-4ffa-a90a-9f850ad99b11 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:34.189489 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fcdc1a15-e93c-4ffa-a90a-9f850ad99b11 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:34.190659 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:34.204103 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-f0ce0451-556c-49c8-96cf-f2f7da3bd92b req-a0540380-f80f-467d-8e96-07189805cf38 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:34.204828 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-f0ce0451-556c-49c8-96cf-f2f7da3bd92b req-a0540380-f80f-467d-8e96-07189805cf38 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:34.207016 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-f0ce0451-556c-49c8-96cf-f2f7da3bd92b req-a0540380-f80f-467d-8e96-07189805cf38 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:34.232534 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fcdc1a15-e93c-4ffa-a90a-9f850ad99b11 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:51:34.240321 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-f0ce0451-556c-49c8-96cf-f2f7da3bd92b req-a0540380-f80f-467d-8e96-07189805cf38 service nova] Creating event network-changed:aca05bcd-9297-4365-a6e9-dca538228f87 for instance c12ad125-6f29-4ee3-971f-d1c23391c89f on hv-cinder-85220 Aug 05 20:51:34.247776 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-f0ce0451-556c-49c8-96cf-f2f7da3bd92b req-a0540380-f80f-467d-8e96-07189805cf38 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071512 Aug 05 20:51:34.248430 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 495/1014] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 20:51:34.351125 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fcdc1a15-e93c-4ffa-a90a-9f850ad99b11 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 204 len: 0 microversion: 2.1 time: 0.177210 Aug 05 20:51:34.352049 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 520/1015] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:51:34 2022] DELETE /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:51:34.361835 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4efd5e36-f2a7-4130-85cb-2d70843fa60a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:34.362804 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4efd5e36-f2a7-4130-85cb-2d70843fa60a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:34.376019 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4efd5e36-f2a7-4130-85cb-2d70843fa60a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:34.376647 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4efd5e36-f2a7-4130-85cb-2d70843fa60a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:34.377186 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4efd5e36-f2a7-4130-85cb-2d70843fa60a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:34.377986 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4efd5e36-f2a7-4130-85cb-2d70843fa60a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:34.378664 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4efd5e36-f2a7-4130-85cb-2d70843fa60a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:34.379304 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4efd5e36-f2a7-4130-85cb-2d70843fa60a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:34.544515 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4efd5e36-f2a7-4130-85cb-2d70843fa60a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:34.555570 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4efd5e36-f2a7-4130-85cb-2d70843fa60a tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1568 microversion: 2.1 time: 0.198532 Aug 05 20:51:34.556149 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 496/1016] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:34 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:35.578549 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-05f26247-1cdb-4b09-bca2-d25cdfd5496f tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:35.579403 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-05f26247-1cdb-4b09-bca2-d25cdfd5496f tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:35.586246 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-05f26247-1cdb-4b09-bca2-d25cdfd5496f tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:35.586832 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-05f26247-1cdb-4b09-bca2-d25cdfd5496f tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:35.587382 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-05f26247-1cdb-4b09-bca2-d25cdfd5496f tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:35.588155 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-05f26247-1cdb-4b09-bca2-d25cdfd5496f tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:35.588692 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-05f26247-1cdb-4b09-bca2-d25cdfd5496f tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:35.589191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-05f26247-1cdb-4b09-bca2-d25cdfd5496f tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:35.830597 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-05f26247-1cdb-4b09-bca2-d25cdfd5496f tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:35.851312 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-05f26247-1cdb-4b09-bca2-d25cdfd5496f tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1568 microversion: 2.1 time: 0.277076 Aug 05 20:51:35.852012 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 521/1017] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:35 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1568 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:36.645145 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-4b4d7209-6365-4d9b-bd7b-89bd1a745749 req-4baf9dad-d30f-47e3-ac87-f306ed9f0246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12ad125-6f29-4ee3-971f-d1c23391c89f", "name": "network-vif-deleted", "tag": "aca05bcd-9297-4365-a6e9-dca538228f87"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:51:36.655629 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-4b4d7209-6365-4d9b-bd7b-89bd1a745749 req-4baf9dad-d30f-47e3-ac87-f306ed9f0246 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:36.656253 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-4b4d7209-6365-4d9b-bd7b-89bd1a745749 req-4baf9dad-d30f-47e3-ac87-f306ed9f0246 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:36.656716 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-4b4d7209-6365-4d9b-bd7b-89bd1a745749 req-4baf9dad-d30f-47e3-ac87-f306ed9f0246 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:36.668958 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-4b4d7209-6365-4d9b-bd7b-89bd1a745749 req-4baf9dad-d30f-47e3-ac87-f306ed9f0246 service nova] Creating event network-vif-deleted:aca05bcd-9297-4365-a6e9-dca538228f87 for instance c12ad125-6f29-4ee3-971f-d1c23391c89f on hv-cinder-85220 Aug 05 20:51:36.674427 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-4b4d7209-6365-4d9b-bd7b-89bd1a745749 req-4baf9dad-d30f-47e3-ac87-f306ed9f0246 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032880 Aug 05 20:51:36.675036 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 497/1018] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:51:36.874051 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-9752dffb-64e0-4f0c-8bf0-34b3ec3e048c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:36.874840 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-9752dffb-64e0-4f0c-8bf0-34b3ec3e048c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:36.881041 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9752dffb-64e0-4f0c-8bf0-34b3ec3e048c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:36.881672 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9752dffb-64e0-4f0c-8bf0-34b3ec3e048c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:36.882460 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9752dffb-64e0-4f0c-8bf0-34b3ec3e048c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:36.883182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9752dffb-64e0-4f0c-8bf0-34b3ec3e048c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:36.883699 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9752dffb-64e0-4f0c-8bf0-34b3ec3e048c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:36.889015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-9752dffb-64e0-4f0c-8bf0-34b3ec3e048c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:36.979263 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-9752dffb-64e0-4f0c-8bf0-34b3ec3e048c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:36.987191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-9752dffb-64e0-4f0c-8bf0-34b3ec3e048c tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1501 microversion: 2.1 time: 0.117277 Aug 05 20:51:36.988245 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 522/1019] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:36 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1501 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:51:38.010527 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a9f9db1e-8812-49eb-a50b-4872e5c1e775 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:38.011762 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a9f9db1e-8812-49eb-a50b-4872e5c1e775 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:38.026048 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a9f9db1e-8812-49eb-a50b-4872e5c1e775 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:38.026576 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a9f9db1e-8812-49eb-a50b-4872e5c1e775 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:38.026975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a9f9db1e-8812-49eb-a50b-4872e5c1e775 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:38.028051 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a9f9db1e-8812-49eb-a50b-4872e5c1e775 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:38.028520 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a9f9db1e-8812-49eb-a50b-4872e5c1e775 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:38.028871 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a9f9db1e-8812-49eb-a50b-4872e5c1e775 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:38.099784 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-a9f9db1e-8812-49eb-a50b-4872e5c1e775 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:38.107594 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a9f9db1e-8812-49eb-a50b-4872e5c1e775 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1501 microversion: 2.1 time: 0.101600 Aug 05 20:51:38.108211 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 498/1020] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:38 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1501 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:39.129703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c49c3e03-993d-4578-a3d5-90c3a3c201de tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:39.130290 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c49c3e03-993d-4578-a3d5-90c3a3c201de tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:39.132337 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:51:39.138786 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c49c3e03-993d-4578-a3d5-90c3a3c201de tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:39.139761 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c49c3e03-993d-4578-a3d5-90c3a3c201de tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:39.140469 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c49c3e03-993d-4578-a3d5-90c3a3c201de tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:39.140865 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c49c3e03-993d-4578-a3d5-90c3a3c201de tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:39.141378 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c49c3e03-993d-4578-a3d5-90c3a3c201de tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:39.141734 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c49c3e03-993d-4578-a3d5-90c3a3c201de tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:39.207644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-c49c3e03-993d-4578-a3d5-90c3a3c201de tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:39.216336 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c49c3e03-993d-4578-a3d5-90c3a3c201de tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1501 microversion: 2.1 time: 0.091111 Aug 05 20:51:39.217048 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 523/1021] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:39 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1501 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:40.238881 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-7739ad00-0d72-471e-b995-8f4b0207a6a7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:40.240525 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-7739ad00-0d72-471e-b995-8f4b0207a6a7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:40.249535 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7739ad00-0d72-471e-b995-8f4b0207a6a7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:40.250077 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7739ad00-0d72-471e-b995-8f4b0207a6a7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:40.250516 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7739ad00-0d72-471e-b995-8f4b0207a6a7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:40.251514 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7739ad00-0d72-471e-b995-8f4b0207a6a7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:40.251975 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7739ad00-0d72-471e-b995-8f4b0207a6a7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:40.252403 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7739ad00-0d72-471e-b995-8f4b0207a6a7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:40.306633 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7739ad00-0d72-471e-b995-8f4b0207a6a7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:40.307124 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7739ad00-0d72-471e-b995-8f4b0207a6a7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:40.307595 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-7739ad00-0d72-471e-b995-8f4b0207a6a7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:40.308053 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-7739ad00-0d72-471e-b995-8f4b0207a6a7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lazy-loading 'fault' on Instance uuid c12ad125-6f29-4ee3-971f-d1c23391c89f {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:51:40.361803 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-7739ad00-0d72-471e-b995-8f4b0207a6a7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9808a95e377143e2a77547c14e7932a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14277b321e0043f9a0846cc4949465c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:51:40.370413 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-7739ad00-0d72-471e-b995-8f4b0207a6a7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 200 len: 1389 microversion: 2.1 time: 0.136435 Aug 05 20:51:40.371201 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 499/1022] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:40 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 1389 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:51:41.393745 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2a7769eb-dfa7-40cc-899c-bdd78e837978 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:41.394353 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2a7769eb-dfa7-40cc-899c-bdd78e837978 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] [instance: c12ad125-6f29-4ee3-971f-d1c23391c89f] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:51:41.403519 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a7769eb-dfa7-40cc-899c-bdd78e837978 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:41.403782 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a7769eb-dfa7-40cc-899c-bdd78e837978 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:41.404379 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a7769eb-dfa7-40cc-899c-bdd78e837978 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:41.405147 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a7769eb-dfa7-40cc-899c-bdd78e837978 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:51:41.405958 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a7769eb-dfa7-40cc-899c-bdd78e837978 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:51:41.406583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2a7769eb-dfa7-40cc-899c-bdd78e837978 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:51:41.422826 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-2a7769eb-dfa7-40cc-899c-bdd78e837978 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] HTTP exception thrown: Instance c12ad125-6f29-4ee3-971f-d1c23391c89f could not be found. Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2a7769eb-dfa7-40cc-899c-bdd78e837978 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Request method failure captured: Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f HTTP/1.1 Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YGIDGDb3tfkMlHiRwh9rL6qQeVUmSWftwS2jhb8RzXL3__SW2OdRNXQuwwMDZYfz4fucUNq-6KkXOdiTyAeyPVF4-Fu22X4se_P5czYd2TPjqVaAfouQDLYw_JVFuzvQ_MK5S1d0vSBHMtM8R3MuOTVNqs9W4YSDLNeAApMLluzG7Q Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 14277b321e0043f9a0846cc4949465c7 Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-TestShelveInstance-671856261 Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:51:41.427583 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:51:41.429244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/14277b321e0043f9a0846cc4949465c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/14277b321e0043f9a0846cc4949465c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/14277b321e0043f9a0846cc4949465c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_14277b321e0043f9a0846cc4949465c7", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:51:41.429244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-TestShelveInstance-671856261 Aug 05 20:51:41.429244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 14277b321e0043f9a0846cc4949465c7 Aug 05 20:51:41.429244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-TestShelveInstance-671856261 Aug 05 20:51:41.429244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-TestShelveInstance-671856261-project Aug 05 20:51:41.429244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:51:41.429244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:51:41.429244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 9808a95e377143e2a77547c14e7932a4 Aug 05 20:51:41.429244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-TestShelveInstance-671856261-project Aug 05 20:51:41.429244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:51:41.429244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance c12ad125-6f29-4ee3-971f-d1c23391c89f could not be found. Aug 05 20:51:41.429244 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': 'c12ad125-6f29-4ee3-971f-d1c23391c89f'} Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c12ad125-6f29-4ee3-971f-d1c23391c89f could not be found. Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:51:41.430107 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c12ad125-6f29-4ee3-971f-d1c23391c89f could not be found. Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c12ad125-6f29-4ee3-971f-d1c23391c89f could not be found. Aug 05 20:51:41.432709 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:51:41.434436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2a7769eb-dfa7-40cc-899c-bdd78e837978 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Returning 404 to user: Instance c12ad125-6f29-4ee3-971f-d1c23391c89f could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:51:41.434436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2a7769eb-dfa7-40cc-899c-bdd78e837978 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f" status: 404 len: 111 microversion: 2.1 time: 0.038985 Aug 05 20:51:41.434436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 524/1023] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:51:41 2022] GET /compute/v2.1/servers/c12ad125-6f29-4ee3-971f-d1c23391c89f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:51:41.634881 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-84196aab-43d1-49f9-a2cc-8df8cc5c46f7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] Calling method '.version_select at 0x7f9be752faf0>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:51:41.663693 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-84196aab-43d1-49f9-a2cc-8df8cc5c46f7 tempest-TestShelveInstance-671856261 tempest-TestShelveInstance-671856261-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-31510839" status: 202 len: 0 microversion: 2.1 time: 0.033967 Aug 05 20:51:41.664607 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 500/1024] 10.222.0.100 () {58 vars in 1253 bytes} [Fri Aug 5 20:51:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-31510839 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:52:01.953369 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1699756035", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "networks": [{"uuid": "cc80e71e-a1fe-4e2a-a21d-2281253b4cd1"}]}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:52:01.965218 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:01.965786 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:02.023673 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.network.neutron [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] validate_networks() for [('cc80e71e-a1fe-4e2a-a21d-2281253b4cd1', None, None, None, None, None)] {{(pid=124432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:52:02.497670 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Flavor limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:52:02.498432 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Image limits 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:52:02.499039 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Flavor pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:52:02.499313 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Image pref 0:0:0 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:52:02.499608 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.virt.hardware [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:52:02.509004 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:02.509481 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:02.509906 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:02.510613 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:02.511056 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:02.511511 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:02.529249 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Getting quotas for project 2508b437eb7248cc96db6094d6ee1bd8. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:52:02.533795 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.quota [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Getting quotas for user 5f96ea7de0d74d2393afd458cb6ff74c and project 2508b437eb7248cc96db6094d6ee1bd8. Resources: {'cores', 'instances', 'ram'} {{(pid=124432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:52:02.545721 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Going to run 1 instances... {{(pid=124432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:52:02.551294 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:52:02.601750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e6fa0acc-ea1a-481c-b6a5-92daaeb02c95 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.653044 Aug 05 20:52:02.602678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 525/1025] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:52:01 2022] POST /compute/v2.1/servers => generated 382 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:52:02.611810 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=25 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:02.612793 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:02.617195 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-40e055c7-bc21-4932-857e-bf0185bbd370 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:52:02.617898 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-40e055c7-bc21-4932-857e-bf0185bbd370 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:52:02.690086 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-40e055c7-bc21-4932-857e-bf0185bbd370 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:52:02.699090 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-40e055c7-bc21-4932-857e-bf0185bbd370 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1223 microversion: 2.1 time: 0.088818 Aug 05 20:52:02.699917 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 501/1026] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:52:02 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:52:03.719390 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ff7c2de3-4d9c-44f8-b2b1-e9191714465f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:52:03.720712 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ff7c2de3-4d9c-44f8-b2b1-e9191714465f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:52:03.730514 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ff7c2de3-4d9c-44f8-b2b1-e9191714465f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:03.731015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ff7c2de3-4d9c-44f8-b2b1-e9191714465f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:03.731442 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ff7c2de3-4d9c-44f8-b2b1-e9191714465f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:03.732433 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ff7c2de3-4d9c-44f8-b2b1-e9191714465f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:03.732886 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ff7c2de3-4d9c-44f8-b2b1-e9191714465f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:03.733416 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ff7c2de3-4d9c-44f8-b2b1-e9191714465f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:03.976891 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ff7c2de3-4d9c-44f8-b2b1-e9191714465f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:52:03.986993 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ff7c2de3-4d9c-44f8-b2b1-e9191714465f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1227 microversion: 2.1 time: 0.271484 Aug 05 20:52:03.988150 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 526/1027] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:52:03 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1227 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:52:05.007984 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8cdf974d-0f25-480b-8844-4ea1f72885c5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:52:05.008753 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8cdf974d-0f25-480b-8844-4ea1f72885c5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:52:05.015098 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8cdf974d-0f25-480b-8844-4ea1f72885c5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:05.015684 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8cdf974d-0f25-480b-8844-4ea1f72885c5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:05.016193 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8cdf974d-0f25-480b-8844-4ea1f72885c5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:05.016938 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8cdf974d-0f25-480b-8844-4ea1f72885c5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:05.017449 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8cdf974d-0f25-480b-8844-4ea1f72885c5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:05.017942 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8cdf974d-0f25-480b-8844-4ea1f72885c5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:05.081895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8cdf974d-0f25-480b-8844-4ea1f72885c5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:52:05.094223 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8cdf974d-0f25-480b-8844-4ea1f72885c5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1227 microversion: 2.1 time: 0.090152 Aug 05 20:52:05.095166 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 502/1028] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:52:05 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1227 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:52:06.118857 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-aa68c7da-617c-43bc-8cd9-38d96bf27744 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:52:06.119837 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-aa68c7da-617c-43bc-8cd9-38d96bf27744 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:52:06.129885 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa68c7da-617c-43bc-8cd9-38d96bf27744 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:06.130449 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa68c7da-617c-43bc-8cd9-38d96bf27744 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:06.130956 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa68c7da-617c-43bc-8cd9-38d96bf27744 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:06.131907 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa68c7da-617c-43bc-8cd9-38d96bf27744 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:06.132436 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa68c7da-617c-43bc-8cd9-38d96bf27744 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:06.133094 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-aa68c7da-617c-43bc-8cd9-38d96bf27744 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:06.235093 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-aa68c7da-617c-43bc-8cd9-38d96bf27744 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:52:06.243655 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-aa68c7da-617c-43bc-8cd9-38d96bf27744 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1281 microversion: 2.1 time: 0.130395 Aug 05 20:52:06.244450 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 527/1029] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:52:06 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1281 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:52:07.088275 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-ae73d5d6-1fc0-4c49-a4aa-c00a9ad3940d req-468acde1-f381-41e9-88af-9e4921201234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6bfd8b4-756c-4163-bd33-a5f707d8c685", "tag": "0997365d-9f52-489c-9236-11d0c581e218"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:52:07.102494 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-ae73d5d6-1fc0-4c49-a4aa-c00a9ad3940d req-468acde1-f381-41e9-88af-9e4921201234 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:07.103137 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-ae73d5d6-1fc0-4c49-a4aa-c00a9ad3940d req-468acde1-f381-41e9-88af-9e4921201234 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:07.103653 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-ae73d5d6-1fc0-4c49-a4aa-c00a9ad3940d req-468acde1-f381-41e9-88af-9e4921201234 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:07.118178 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-ae73d5d6-1fc0-4c49-a4aa-c00a9ad3940d req-468acde1-f381-41e9-88af-9e4921201234 service nova] Creating event network-changed:0997365d-9f52-489c-9236-11d0c581e218 for instance d6bfd8b4-756c-4163-bd33-a5f707d8c685 on hv-cinder-85220 Aug 05 20:52:07.125382 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-ae73d5d6-1fc0-4c49-a4aa-c00a9ad3940d req-468acde1-f381-41e9-88af-9e4921201234 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040859 Aug 05 20:52:07.125993 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 503/1030] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:52:07.265524 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a85c343d-8697-44ac-8656-c9fd7b87de30 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:52:07.266073 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a85c343d-8697-44ac-8656-c9fd7b87de30 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:52:07.272524 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a85c343d-8697-44ac-8656-c9fd7b87de30 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:07.273015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a85c343d-8697-44ac-8656-c9fd7b87de30 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:07.273458 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a85c343d-8697-44ac-8656-c9fd7b87de30 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:07.274155 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a85c343d-8697-44ac-8656-c9fd7b87de30 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:07.274892 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a85c343d-8697-44ac-8656-c9fd7b87de30 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:07.275342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-a85c343d-8697-44ac-8656-c9fd7b87de30 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:07.501545 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a85c343d-8697-44ac-8656-c9fd7b87de30 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:52:07.509327 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a85c343d-8697-44ac-8656-c9fd7b87de30 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1323 microversion: 2.1 time: 0.248075 Aug 05 20:52:07.509917 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 528/1031] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:52:07 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1323 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:52:08.532201 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-b9f8f2cf-62c3-481a-b8a7-04f278850771 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:52:08.532831 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-b9f8f2cf-62c3-481a-b8a7-04f278850771 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:52:08.539878 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b9f8f2cf-62c3-481a-b8a7-04f278850771 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:08.540294 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b9f8f2cf-62c3-481a-b8a7-04f278850771 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:08.540722 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b9f8f2cf-62c3-481a-b8a7-04f278850771 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:08.541415 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b9f8f2cf-62c3-481a-b8a7-04f278850771 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:08.541862 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b9f8f2cf-62c3-481a-b8a7-04f278850771 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:08.542278 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-b9f8f2cf-62c3-481a-b8a7-04f278850771 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:08.808832 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-b9f8f2cf-62c3-481a-b8a7-04f278850771 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:52:08.818996 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-b9f8f2cf-62c3-481a-b8a7-04f278850771 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1323 microversion: 2.1 time: 0.290679 Aug 05 20:52:08.820701 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 504/1032] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:52:08 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1323 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:52:09.841771 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5dd0d5f7-50e1-49de-9045-4c4d0ce42e09 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:52:09.843108 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5dd0d5f7-50e1-49de-9045-4c4d0ce42e09 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:52:09.850480 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5dd0d5f7-50e1-49de-9045-4c4d0ce42e09 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:09.851326 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5dd0d5f7-50e1-49de-9045-4c4d0ce42e09 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:09.851983 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5dd0d5f7-50e1-49de-9045-4c4d0ce42e09 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:09.853027 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5dd0d5f7-50e1-49de-9045-4c4d0ce42e09 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:09.853764 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5dd0d5f7-50e1-49de-9045-4c4d0ce42e09 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:09.855006 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5dd0d5f7-50e1-49de-9045-4c4d0ce42e09 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:09.998913 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5dd0d5f7-50e1-49de-9045-4c4d0ce42e09 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:52:10.007966 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5dd0d5f7-50e1-49de-9045-4c4d0ce42e09 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1323 microversion: 2.1 time: 0.171096 Aug 05 20:52:10.008755 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 529/1033] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:52:09 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1323 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:52:11.030397 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-1ea18bc7-3280-4d89-90e3-9d04b44371b9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:52:11.031000 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-1ea18bc7-3280-4d89-90e3-9d04b44371b9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:52:11.038019 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1ea18bc7-3280-4d89-90e3-9d04b44371b9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:11.038490 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1ea18bc7-3280-4d89-90e3-9d04b44371b9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:11.038912 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1ea18bc7-3280-4d89-90e3-9d04b44371b9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:11.039651 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1ea18bc7-3280-4d89-90e3-9d04b44371b9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:11.040111 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1ea18bc7-3280-4d89-90e3-9d04b44371b9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:11.040542 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-1ea18bc7-3280-4d89-90e3-9d04b44371b9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:11.193251 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-1ea18bc7-3280-4d89-90e3-9d04b44371b9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:52:11.201351 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-1ea18bc7-3280-4d89-90e3-9d04b44371b9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1323 microversion: 2.1 time: 0.174886 Aug 05 20:52:11.201680 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 505/1034] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:52:11 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1323 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:52:12.203226 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-6cd2319b-2ece-4e6d-af13-b90dedd5e567 req-ccef70c5-0d9c-411d-bff4-e7b769d2f6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6bfd8b4-756c-4163-bd33-a5f707d8c685", "name": "network-vif-plugged", "status": "completed", "tag": "0997365d-9f52-489c-9236-11d0c581e218"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:52:12.214341 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-6cd2319b-2ece-4e6d-af13-b90dedd5e567 req-ccef70c5-0d9c-411d-bff4-e7b769d2f6f5 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:12.216739 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-6cd2319b-2ece-4e6d-af13-b90dedd5e567 req-ccef70c5-0d9c-411d-bff4-e7b769d2f6f5 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:12.217431 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-6cd2319b-2ece-4e6d-af13-b90dedd5e567 req-ccef70c5-0d9c-411d-bff4-e7b769d2f6f5 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:12.221958 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-457e2e6d-9561-48d6-babb-1d0e92085174 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:52:12.223210 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-457e2e6d-9561-48d6-babb-1d0e92085174 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:52:12.230159 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-6cd2319b-2ece-4e6d-af13-b90dedd5e567 req-ccef70c5-0d9c-411d-bff4-e7b769d2f6f5 service nova] Creating event network-vif-plugged:0997365d-9f52-489c-9236-11d0c581e218 for instance d6bfd8b4-756c-4163-bd33-a5f707d8c685 on hv-cinder-85220 Aug 05 20:52:12.230363 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-457e2e6d-9561-48d6-babb-1d0e92085174 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:12.230735 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-457e2e6d-9561-48d6-babb-1d0e92085174 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:12.231175 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-457e2e6d-9561-48d6-babb-1d0e92085174 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:12.232222 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-457e2e6d-9561-48d6-babb-1d0e92085174 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:12.232741 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-457e2e6d-9561-48d6-babb-1d0e92085174 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:12.233281 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-457e2e6d-9561-48d6-babb-1d0e92085174 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:12.236752 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-6cd2319b-2ece-4e6d-af13-b90dedd5e567 req-ccef70c5-0d9c-411d-bff4-e7b769d2f6f5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037313 Aug 05 20:52:12.237404 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 530/1035] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:52:12.375539 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-457e2e6d-9561-48d6-babb-1d0e92085174 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:52:12.383177 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-457e2e6d-9561-48d6-babb-1d0e92085174 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1323 microversion: 2.1 time: 0.165408 Aug 05 20:52:12.383832 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 506/1036] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:52:12 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1323 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:52:13.407250 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-657fb1ca-d495-4e9d-aeab-41bad656494a tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:52:13.408333 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-657fb1ca-d495-4e9d-aeab-41bad656494a tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:52:13.418659 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:13.419228 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=6 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:13.431802 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-657fb1ca-d495-4e9d-aeab-41bad656494a tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:13.431909 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-657fb1ca-d495-4e9d-aeab-41bad656494a tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:13.432415 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-657fb1ca-d495-4e9d-aeab-41bad656494a tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:13.433191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-657fb1ca-d495-4e9d-aeab-41bad656494a tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:13.433623 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-657fb1ca-d495-4e9d-aeab-41bad656494a tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:13.434608 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-657fb1ca-d495-4e9d-aeab-41bad656494a tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:13.584901 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-657fb1ca-d495-4e9d-aeab-41bad656494a tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:52:13.593092 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-657fb1ca-d495-4e9d-aeab-41bad656494a tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1323 microversion: 2.1 time: 0.192658 Aug 05 20:52:13.593651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 531/1037] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:52:13 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1323 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:52:14.614071 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3145f82c-e124-411f-a7c4-1a240561025f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:52:14.615255 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3145f82c-e124-411f-a7c4-1a240561025f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:52:14.617362 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:14.623911 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3145f82c-e124-411f-a7c4-1a240561025f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:14.624402 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3145f82c-e124-411f-a7c4-1a240561025f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:14.624844 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3145f82c-e124-411f-a7c4-1a240561025f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:14.625548 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3145f82c-e124-411f-a7c4-1a240561025f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:14.626297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3145f82c-e124-411f-a7c4-1a240561025f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:14.626716 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3145f82c-e124-411f-a7c4-1a240561025f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:14.772350 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-3145f82c-e124-411f-a7c4-1a240561025f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:52:14.781221 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3145f82c-e124-411f-a7c4-1a240561025f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1323 microversion: 2.1 time: 0.171075 Aug 05 20:52:14.782019 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 507/1038] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:52:14 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1323 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:52:15.806703 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-fb138b00-d95e-47cb-91e4-a730d3888062 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:52:15.807682 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-fb138b00-d95e-47cb-91e4-a730d3888062 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:52:15.818722 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb138b00-d95e-47cb-91e4-a730d3888062 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:15.819598 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb138b00-d95e-47cb-91e4-a730d3888062 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:15.820325 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb138b00-d95e-47cb-91e4-a730d3888062 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:15.821471 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb138b00-d95e-47cb-91e4-a730d3888062 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:15.822247 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb138b00-d95e-47cb-91e4-a730d3888062 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:15.822951 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-fb138b00-d95e-47cb-91e4-a730d3888062 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:15.980743 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-fb138b00-d95e-47cb-91e4-a730d3888062 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:52:15.988485 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-fb138b00-d95e-47cb-91e4-a730d3888062 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1323 microversion: 2.1 time: 0.188711 Aug 05 20:52:15.989056 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 532/1039] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:52:15 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1323 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:52:17.009918 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-48cb7321-7807-40e5-9aeb-45c9cebd6e69 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:52:17.011168 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-48cb7321-7807-40e5-9aeb-45c9cebd6e69 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:52:17.018506 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-48cb7321-7807-40e5-9aeb-45c9cebd6e69 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:17.019062 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-48cb7321-7807-40e5-9aeb-45c9cebd6e69 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:17.020188 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-48cb7321-7807-40e5-9aeb-45c9cebd6e69 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:17.020954 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-48cb7321-7807-40e5-9aeb-45c9cebd6e69 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:17.021544 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-48cb7321-7807-40e5-9aeb-45c9cebd6e69 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:17.021994 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-48cb7321-7807-40e5-9aeb-45c9cebd6e69 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:17.172988 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-48cb7321-7807-40e5-9aeb-45c9cebd6e69 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:52:17.180782 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-48cb7321-7807-40e5-9aeb-45c9cebd6e69 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1512 microversion: 2.1 time: 0.175232 Aug 05 20:52:17.181344 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 508/1040] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:52:17 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:52:38.186045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:52:38.186675 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Fri Aug 5 20:52:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:52:42.012648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d9cc6b7b-dee8-4f44-ad7f-7d7b4ceaf0af tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d89cefd0-e7a5-48e7-8149-abf445a3bfe3", "device": "/dev/sdb"}} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:52:42.016948 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d9cc6b7b-dee8-4f44-ad7f-7d7b4ceaf0af tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:52:42.020393 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:42.021365 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=40 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:52:42.030724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9cc6b7b-dee8-4f44-ad7f-7d7b4ceaf0af tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:42.031219 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9cc6b7b-dee8-4f44-ad7f-7d7b4ceaf0af tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:42.031678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9cc6b7b-dee8-4f44-ad7f-7d7b4ceaf0af tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:42.032363 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9cc6b7b-dee8-4f44-ad7f-7d7b4ceaf0af tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:52:42.032844 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9cc6b7b-dee8-4f44-ad7f-7d7b4ceaf0af tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:52:42.033288 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d9cc6b7b-dee8-4f44-ad7f-7d7b4ceaf0af tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:52:42.302705 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d9cc6b7b-dee8-4f44-ad7f-7d7b4ceaf0af tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "POST /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296390 Aug 05 20:52:42.309424 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 533/1041] 10.222.0.100 () {60 vars in 1328 bytes} [Fri Aug 5 20:52:42 2022] POST /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:53:14.608855 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-494979957", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1555072571", "security_groups": [{"name": "tempest-secgroup-smoke-1169758282"}], "block_device_mapping_v2": [{"uuid": "d9c62370-5d6f-408c-b817-73ab7309fe1a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2da7eabb-8388-4a2d-b214-d5f4a8b84731"}]}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:53:14.618707 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=18 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:14.619430 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=38 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:14.735114 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.network.neutron [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] validate_networks() for [('2da7eabb-8388-4a2d-b214-d5f4a8b84731', None, None, None, None, None)] {{(pid=124431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:53:15.221057 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Flavor limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:53:15.221481 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Image limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:53:15.221947 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Flavor pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:53:15.222350 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Image pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:53:15.222755 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:53:15.232385 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:15.232899 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:15.233332 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:15.234056 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:15.234517 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:15.234940 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:15.252805 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Getting quotas for project c671352d2d2c475ab5c58932b6ecf5bc. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:53:15.257352 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Getting quotas for user 9b5ea50e80674c9f96821af04540ba39 and project c671352d2d2c475ab5c58932b6ecf5bc. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:53:15.319341 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Going to run 1 instances... {{(pid=124431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:53:15.321490 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d9c62370-5d6f-408c-b817-73ab7309fe1a',volume_size=None,volume_type=None)] {{(pid=124431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:53:15.474859 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-2f759278-efd7-478a-b504-ad387ecaaa7a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.869756 Aug 05 20:53:15.475421 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 509/1042] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:53:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:53:15.488869 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-a3275d8a-f132-4c9f-a931-702c8c2c2f7d tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:15.490724 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-a3275d8a-f132-4c9f-a931-702c8c2c2f7d tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:15.493434 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:15.494181 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:15.550818 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-a3275d8a-f132-4c9f-a931-702c8c2c2f7d tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:15.558476 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-a3275d8a-f132-4c9f-a931-702c8c2c2f7d tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1097 microversion: 2.1 time: 0.075013 Aug 05 20:53:15.559112 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 534/1043] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:15 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1097 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:16.582265 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-fed204c3-4f72-4fe3-ba9f-b5680fe6dc26 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:16.584499 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-fed204c3-4f72-4fe3-ba9f-b5680fe6dc26 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:16.594624 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fed204c3-4f72-4fe3-ba9f-b5680fe6dc26 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:16.595622 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fed204c3-4f72-4fe3-ba9f-b5680fe6dc26 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:16.596989 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fed204c3-4f72-4fe3-ba9f-b5680fe6dc26 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:16.598406 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fed204c3-4f72-4fe3-ba9f-b5680fe6dc26 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:16.599542 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fed204c3-4f72-4fe3-ba9f-b5680fe6dc26 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:16.600345 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-fed204c3-4f72-4fe3-ba9f-b5680fe6dc26 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:16.690046 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-fed204c3-4f72-4fe3-ba9f-b5680fe6dc26 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:16.700441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-fed204c3-4f72-4fe3-ba9f-b5680fe6dc26 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1203 microversion: 2.1 time: 0.125282 Aug 05 20:53:16.702007 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 510/1044] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:16 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1203 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:17.722308 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-124b7923-0df4-4943-8fa6-b282ee3c6a60 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:17.722985 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-124b7923-0df4-4943-8fa6-b282ee3c6a60 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:17.732473 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-124b7923-0df4-4943-8fa6-b282ee3c6a60 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:17.733192 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-124b7923-0df4-4943-8fa6-b282ee3c6a60 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:17.733960 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-124b7923-0df4-4943-8fa6-b282ee3c6a60 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:17.734890 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-124b7923-0df4-4943-8fa6-b282ee3c6a60 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:17.735581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-124b7923-0df4-4943-8fa6-b282ee3c6a60 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:17.736207 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-124b7923-0df4-4943-8fa6-b282ee3c6a60 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:17.829352 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-cd8413ed-c4a6-429e-937e-137d0cb68ccf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:17.830111 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-cd8413ed-c4a6-429e-937e-137d0cb68ccf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:17.836416 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd8413ed-c4a6-429e-937e-137d0cb68ccf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:17.837438 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd8413ed-c4a6-429e-937e-137d0cb68ccf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:17.838226 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd8413ed-c4a6-429e-937e-137d0cb68ccf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:17.839093 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd8413ed-c4a6-429e-937e-137d0cb68ccf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:17.839836 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd8413ed-c4a6-429e-937e-137d0cb68ccf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:17.840678 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-cd8413ed-c4a6-429e-937e-137d0cb68ccf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:17.927574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-cd8413ed-c4a6-429e-937e-137d0cb68ccf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lazy-loading 'services' on Instance uuid d6bfd8b4-756c-4163-bd33-a5f707d8c685 {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:53:17.948736 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-124b7923-0df4-4943-8fa6-b282ee3c6a60 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:17.959793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-124b7923-0df4-4943-8fa6-b282ee3c6a60 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.241205 Aug 05 20:53:17.973908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 535/1045] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:17 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:53:18.030121 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-cd8413ed-c4a6-429e-937e-137d0cb68ccf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "DELETE /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685/os-volume_attachments/d89cefd0-e7a5-48e7-8149-abf445a3bfe3" status: 202 len: 0 microversion: 2.1 time: 0.204511 Aug 05 20:53:18.030716 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 511/1046] 10.222.0.100 () {58 vars in 1421 bytes} [Fri Aug 5 20:53:17 2022] DELETE /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685/os-volume_attachments/d89cefd0-e7a5-48e7-8149-abf445a3bfe3 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:53:18.525024 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-a285cb0b-c6d9-4271-9349-ad2de34be039 req-aa05f9a8-10e1-45aa-8573-34c3317fe1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a51e9e-bda8-4c1b-a205-09c067b141b5", "tag": "0e53e907-d068-4686-8b1f-9791b78869fa"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:53:18.535926 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a285cb0b-c6d9-4271-9349-ad2de34be039 req-aa05f9a8-10e1-45aa-8573-34c3317fe1f1 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:18.536549 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a285cb0b-c6d9-4271-9349-ad2de34be039 req-aa05f9a8-10e1-45aa-8573-34c3317fe1f1 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:18.537210 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a285cb0b-c6d9-4271-9349-ad2de34be039 req-aa05f9a8-10e1-45aa-8573-34c3317fe1f1 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:18.550097 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-a285cb0b-c6d9-4271-9349-ad2de34be039 req-aa05f9a8-10e1-45aa-8573-34c3317fe1f1 service nova] Creating event network-changed:0e53e907-d068-4686-8b1f-9791b78869fa for instance 61a51e9e-bda8-4c1b-a205-09c067b141b5 on hv-cinder-85220 Aug 05 20:53:18.555383 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-a285cb0b-c6d9-4271-9349-ad2de34be039 req-aa05f9a8-10e1-45aa-8573-34c3317fe1f1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034618 Aug 05 20:53:18.556597 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 536/1047] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:53:18.982179 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d6016629-a3b8-4923-b5cd-a93247e6c753 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:18.982941 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d6016629-a3b8-4923-b5cd-a93247e6c753 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:18.990040 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d6016629-a3b8-4923-b5cd-a93247e6c753 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:18.990040 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d6016629-a3b8-4923-b5cd-a93247e6c753 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:18.990040 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d6016629-a3b8-4923-b5cd-a93247e6c753 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:18.990787 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d6016629-a3b8-4923-b5cd-a93247e6c753 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:18.991229 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d6016629-a3b8-4923-b5cd-a93247e6c753 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:18.991692 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d6016629-a3b8-4923-b5cd-a93247e6c753 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:19.135747 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d6016629-a3b8-4923-b5cd-a93247e6c753 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:19.143602 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d6016629-a3b8-4923-b5cd-a93247e6c753 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.166615 Aug 05 20:53:19.144162 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 512/1048] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:18 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:19.172070 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-83497d1c-9991-4410-8368-dd1d8af55b6e tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:19.172725 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-83497d1c-9991-4410-8368-dd1d8af55b6e tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:19.179257 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-83497d1c-9991-4410-8368-dd1d8af55b6e tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:19.179803 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-83497d1c-9991-4410-8368-dd1d8af55b6e tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:19.180240 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-83497d1c-9991-4410-8368-dd1d8af55b6e tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:19.181233 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-83497d1c-9991-4410-8368-dd1d8af55b6e tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:19.181694 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-83497d1c-9991-4410-8368-dd1d8af55b6e tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:19.182121 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-83497d1c-9991-4410-8368-dd1d8af55b6e tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:19.209908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-83497d1c-9991-4410-8368-dd1d8af55b6e tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:53:19.297737 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-83497d1c-9991-4410-8368-dd1d8af55b6e tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "DELETE /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 204 len: 0 microversion: 2.1 time: 0.130068 Aug 05 20:53:19.298322 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 537/1049] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:53:19 2022] DELETE /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:53:19.307333 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-71e85274-e857-4853-8552-940af28f920b tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:19.308239 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-71e85274-e857-4853-8552-940af28f920b tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:19.314426 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-71e85274-e857-4853-8552-940af28f920b tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:19.314915 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-71e85274-e857-4853-8552-940af28f920b tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:19.315373 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-71e85274-e857-4853-8552-940af28f920b tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:19.316085 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-71e85274-e857-4853-8552-940af28f920b tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:19.316540 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-71e85274-e857-4853-8552-940af28f920b tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:19.316967 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-71e85274-e857-4853-8552-940af28f920b tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:19.457742 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-71e85274-e857-4853-8552-940af28f920b tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:19.466086 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-71e85274-e857-4853-8552-940af28f920b tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1518 microversion: 2.1 time: 0.163044 Aug 05 20:53:19.466581 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 513/1050] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:19 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:20.168995 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5cbde2a3-285d-4afa-94ef-e68a3b3ff512 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:20.170008 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5cbde2a3-285d-4afa-94ef-e68a3b3ff512 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:20.180654 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5cbde2a3-285d-4afa-94ef-e68a3b3ff512 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:20.181466 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5cbde2a3-285d-4afa-94ef-e68a3b3ff512 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:20.181808 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5cbde2a3-285d-4afa-94ef-e68a3b3ff512 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:20.182506 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5cbde2a3-285d-4afa-94ef-e68a3b3ff512 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:20.182967 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5cbde2a3-285d-4afa-94ef-e68a3b3ff512 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:20.183397 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5cbde2a3-285d-4afa-94ef-e68a3b3ff512 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:20.337603 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5cbde2a3-285d-4afa-94ef-e68a3b3ff512 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:20.345758 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5cbde2a3-285d-4afa-94ef-e68a3b3ff512 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.183804 Aug 05 20:53:20.346342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 538/1051] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:20 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:20.487495 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8ed60b21-d582-4830-abdd-95aadee7b7f9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:20.488124 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8ed60b21-d582-4830-abdd-95aadee7b7f9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:20.496045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8ed60b21-d582-4830-abdd-95aadee7b7f9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:20.496535 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8ed60b21-d582-4830-abdd-95aadee7b7f9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:20.496972 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8ed60b21-d582-4830-abdd-95aadee7b7f9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:20.497693 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8ed60b21-d582-4830-abdd-95aadee7b7f9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:20.498148 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8ed60b21-d582-4830-abdd-95aadee7b7f9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:20.498577 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8ed60b21-d582-4830-abdd-95aadee7b7f9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:20.635817 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8ed60b21-d582-4830-abdd-95aadee7b7f9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:20.643618 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8ed60b21-d582-4830-abdd-95aadee7b7f9 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1518 microversion: 2.1 time: 0.160296 Aug 05 20:53:20.644214 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 514/1052] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:20 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:21.366701 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2e0665bc-7c80-4c63-8254-8b2b949aa778 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:21.367296 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2e0665bc-7c80-4c63-8254-8b2b949aa778 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:21.374810 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2e0665bc-7c80-4c63-8254-8b2b949aa778 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:21.375324 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2e0665bc-7c80-4c63-8254-8b2b949aa778 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:21.375899 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2e0665bc-7c80-4c63-8254-8b2b949aa778 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:21.376616 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2e0665bc-7c80-4c63-8254-8b2b949aa778 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:21.377101 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2e0665bc-7c80-4c63-8254-8b2b949aa778 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:21.377551 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2e0665bc-7c80-4c63-8254-8b2b949aa778 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:21.520263 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-2e0665bc-7c80-4c63-8254-8b2b949aa778 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:21.531061 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2e0665bc-7c80-4c63-8254-8b2b949aa778 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.168667 Aug 05 20:53:21.531675 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 539/1053] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:21 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:21.665864 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-feb8aa3e-75e2-46c7-b82a-b343f9af6ec3 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:21.666438 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-feb8aa3e-75e2-46c7-b82a-b343f9af6ec3 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:21.673525 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-feb8aa3e-75e2-46c7-b82a-b343f9af6ec3 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:21.674016 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-feb8aa3e-75e2-46c7-b82a-b343f9af6ec3 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:21.674451 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-feb8aa3e-75e2-46c7-b82a-b343f9af6ec3 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:21.675151 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-feb8aa3e-75e2-46c7-b82a-b343f9af6ec3 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:21.675648 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-feb8aa3e-75e2-46c7-b82a-b343f9af6ec3 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:21.676079 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-feb8aa3e-75e2-46c7-b82a-b343f9af6ec3 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:21.828968 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-feb8aa3e-75e2-46c7-b82a-b343f9af6ec3 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:21.837669 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-feb8aa3e-75e2-46c7-b82a-b343f9af6ec3 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1518 microversion: 2.1 time: 0.176152 Aug 05 20:53:21.838242 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 515/1054] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:21 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:22.556873 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-155b50da-529e-406b-b7d9-957b512d71b1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:22.557446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-155b50da-529e-406b-b7d9-957b512d71b1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:22.564675 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-155b50da-529e-406b-b7d9-957b512d71b1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:22.565161 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-155b50da-529e-406b-b7d9-957b512d71b1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:22.565599 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-155b50da-529e-406b-b7d9-957b512d71b1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:22.566292 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-155b50da-529e-406b-b7d9-957b512d71b1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:22.566748 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-155b50da-529e-406b-b7d9-957b512d71b1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:22.567173 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-155b50da-529e-406b-b7d9-957b512d71b1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:22.721349 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-155b50da-529e-406b-b7d9-957b512d71b1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:22.731307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-155b50da-529e-406b-b7d9-957b512d71b1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.181186 Aug 05 20:53:22.731893 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 540/1055] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:22 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:22.859756 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-958b140d-30c2-4585-8a52-700521b7049f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:22.860355 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-958b140d-30c2-4585-8a52-700521b7049f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:22.867538 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-958b140d-30c2-4585-8a52-700521b7049f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:22.868048 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-958b140d-30c2-4585-8a52-700521b7049f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:22.868761 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-958b140d-30c2-4585-8a52-700521b7049f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:22.869220 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-958b140d-30c2-4585-8a52-700521b7049f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:22.869728 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-958b140d-30c2-4585-8a52-700521b7049f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:22.870171 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-958b140d-30c2-4585-8a52-700521b7049f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:23.042111 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-958b140d-30c2-4585-8a52-700521b7049f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:23.050353 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-958b140d-30c2-4585-8a52-700521b7049f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1518 microversion: 2.1 time: 0.194613 Aug 05 20:53:23.051019 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 516/1056] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:22 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:23.752081 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-444e8023-1053-4581-acfd-563b3a759007 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:23.752653 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-444e8023-1053-4581-acfd-563b3a759007 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:23.760318 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-444e8023-1053-4581-acfd-563b3a759007 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:23.760810 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-444e8023-1053-4581-acfd-563b3a759007 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:23.761251 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-444e8023-1053-4581-acfd-563b3a759007 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:23.762608 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-444e8023-1053-4581-acfd-563b3a759007 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:23.762608 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-444e8023-1053-4581-acfd-563b3a759007 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:23.762981 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-444e8023-1053-4581-acfd-563b3a759007 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:23.892164 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-8c1791c5-b2a2-4993-bd99-59a3b961cfd1 req-89088aec-e9d8-4259-a668-139bdf99c640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6bfd8b4-756c-4163-bd33-a5f707d8c685", "name": "network-vif-deleted", "tag": "0997365d-9f52-489c-9236-11d0c581e218"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:53:23.905267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-8c1791c5-b2a2-4993-bd99-59a3b961cfd1 req-89088aec-e9d8-4259-a668-139bdf99c640 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:23.905808 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-8c1791c5-b2a2-4993-bd99-59a3b961cfd1 req-89088aec-e9d8-4259-a668-139bdf99c640 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:23.906361 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-8c1791c5-b2a2-4993-bd99-59a3b961cfd1 req-89088aec-e9d8-4259-a668-139bdf99c640 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:23.920273 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-8c1791c5-b2a2-4993-bd99-59a3b961cfd1 req-89088aec-e9d8-4259-a668-139bdf99c640 service nova] Creating event network-vif-deleted:0997365d-9f52-489c-9236-11d0c581e218 for instance d6bfd8b4-756c-4163-bd33-a5f707d8c685 on hv-cinder-85220 Aug 05 20:53:23.926085 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-8c1791c5-b2a2-4993-bd99-59a3b961cfd1 req-89088aec-e9d8-4259-a668-139bdf99c640 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038984 Aug 05 20:53:23.926992 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 517/1057] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:53:23.965633 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-444e8023-1053-4581-acfd-563b3a759007 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:23.974063 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-444e8023-1053-4581-acfd-563b3a759007 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.225842 Aug 05 20:53:23.974606 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 541/1058] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:23 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:24.072884 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-94e8636d-2466-4323-a564-29efb07cec49 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:24.073503 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-94e8636d-2466-4323-a564-29efb07cec49 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:24.080337 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-94e8636d-2466-4323-a564-29efb07cec49 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:24.080834 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-94e8636d-2466-4323-a564-29efb07cec49 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:24.081275 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-94e8636d-2466-4323-a564-29efb07cec49 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:24.081977 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-94e8636d-2466-4323-a564-29efb07cec49 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:24.082441 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-94e8636d-2466-4323-a564-29efb07cec49 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:24.082873 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-94e8636d-2466-4323-a564-29efb07cec49 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:24.115032 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-94e8636d-2466-4323-a564-29efb07cec49 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:24.115595 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-94e8636d-2466-4323-a564-29efb07cec49 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:24.116101 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-94e8636d-2466-4323-a564-29efb07cec49 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:24.116638 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-94e8636d-2466-4323-a564-29efb07cec49 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lazy-loading 'fault' on Instance uuid d6bfd8b4-756c-4163-bd33-a5f707d8c685 {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:53:24.160087 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-94e8636d-2466-4323-a564-29efb07cec49 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:24.167763 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-94e8636d-2466-4323-a564-29efb07cec49 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 200 len: 1313 microversion: 2.1 time: 0.099684 Aug 05 20:53:24.168334 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 518/1059] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:24 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 1313 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:24.997779 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-38a7c361-275f-49f6-bbce-2955e62719c5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:24.998353 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-38a7c361-275f-49f6-bbce-2955e62719c5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:25.005307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-38a7c361-275f-49f6-bbce-2955e62719c5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:25.005794 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-38a7c361-275f-49f6-bbce-2955e62719c5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:25.006219 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-38a7c361-275f-49f6-bbce-2955e62719c5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:25.006905 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-38a7c361-275f-49f6-bbce-2955e62719c5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:25.007404 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-38a7c361-275f-49f6-bbce-2955e62719c5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:25.007862 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-38a7c361-275f-49f6-bbce-2955e62719c5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:25.143903 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-38a7c361-275f-49f6-bbce-2955e62719c5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:25.152026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-38a7c361-275f-49f6-bbce-2955e62719c5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.158460 Aug 05 20:53:25.152590 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 542/1060] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:24 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:25.188490 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-033a3b02-9246-4eb1-8b92-9ef5761448d4 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:25.189102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-033a3b02-9246-4eb1-8b92-9ef5761448d4 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: d6bfd8b4-756c-4163-bd33-a5f707d8c685] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:25.200373 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-033a3b02-9246-4eb1-8b92-9ef5761448d4 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:25.200863 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-033a3b02-9246-4eb1-8b92-9ef5761448d4 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:25.201297 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-033a3b02-9246-4eb1-8b92-9ef5761448d4 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:25.201998 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-033a3b02-9246-4eb1-8b92-9ef5761448d4 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:25.202453 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-033a3b02-9246-4eb1-8b92-9ef5761448d4 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:25.202882 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-033a3b02-9246-4eb1-8b92-9ef5761448d4 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:25.217119 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-033a3b02-9246-4eb1-8b92-9ef5761448d4 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] HTTP exception thrown: Instance d6bfd8b4-756c-4163-bd33-a5f707d8c685 could not be found. Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-033a3b02-9246-4eb1-8b92-9ef5761448d4 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Request method failure captured: Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 HTTP/1.1 Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YLvM7Wt4OohbutPF5edqRI2S_PMkT3mEkABHdpbJwoDRnPjyJkLBdxLxtkXB6yM1rkE7grcCe_Lf_GEJYOLXoGl2YVzM4YpzYUJI5BMvJwVagobKPYNo8fmuVVCghMxYAntFzo6_4_fI-k5NDMv8CUo0HdqtonGkG-A4YJqsy3QPEI Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: 2508b437eb7248cc96db6094d6ee1bd8 Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1679724835 Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:53:25.218783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:53:25.220432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2508b437eb7248cc96db6094d6ee1bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2508b437eb7248cc96db6094d6ee1bd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2508b437eb7248cc96db6094d6ee1bd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2508b437eb7248cc96db6094d6ee1bd8", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:53:25.220432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-VolumesSnapshotTestJSON-1679724835 Aug 05 20:53:25.220432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: 2508b437eb7248cc96db6094d6ee1bd8 Aug 05 20:53:25.220432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1679724835 Aug 05 20:53:25.220432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-VolumesSnapshotTestJSON-1679724835-project Aug 05 20:53:25.220432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:53:25.220432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:53:25.220432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 5f96ea7de0d74d2393afd458cb6ff74c Aug 05 20:53:25.220432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-VolumesSnapshotTestJSON-1679724835-project Aug 05 20:53:25.220432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:53:25.220432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance d6bfd8b4-756c-4163-bd33-a5f707d8c685 could not be found. Aug 05 20:53:25.220432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': 'd6bfd8b4-756c-4163-bd33-a5f707d8c685'} Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6bfd8b4-756c-4163-bd33-a5f707d8c685 could not be found. Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:53:25.221433 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6bfd8b4-756c-4163-bd33-a5f707d8c685 could not be found. Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6bfd8b4-756c-4163-bd33-a5f707d8c685 could not be found. Aug 05 20:53:25.223058 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:53:25.224528 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-033a3b02-9246-4eb1-8b92-9ef5761448d4 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Returning 404 to user: Instance d6bfd8b4-756c-4163-bd33-a5f707d8c685 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:53:25.224528 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-033a3b02-9246-4eb1-8b92-9ef5761448d4 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685" status: 404 len: 111 microversion: 2.1 time: 0.035674 Aug 05 20:53:25.224528 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 519/1061] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:25 2022] GET /compute/v2.1/servers/d6bfd8b4-756c-4163-bd33-a5f707d8c685 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:53:26.173158 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-35543875-874b-4e55-b0d3-8d07acb2e982 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:26.173739 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-35543875-874b-4e55-b0d3-8d07acb2e982 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:26.175825 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell0:SELECT=2 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:26.181970 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-35543875-874b-4e55-b0d3-8d07acb2e982 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:26.182455 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-35543875-874b-4e55-b0d3-8d07acb2e982 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:26.182886 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-35543875-874b-4e55-b0d3-8d07acb2e982 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:26.183598 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-35543875-874b-4e55-b0d3-8d07acb2e982 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:26.184054 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-35543875-874b-4e55-b0d3-8d07acb2e982 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:26.184478 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-35543875-874b-4e55-b0d3-8d07acb2e982 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:26.322740 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-35543875-874b-4e55-b0d3-8d07acb2e982 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:26.334611 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-35543875-874b-4e55-b0d3-8d07acb2e982 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.165212 Aug 05 20:53:26.335537 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 543/1062] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:26 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:27.359257 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-21bfa0b1-6132-46f8-9978-6e2b3434f7dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:27.360033 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-21bfa0b1-6132-46f8-9978-6e2b3434f7dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:27.362995 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:27.363912 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=6 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:27.373700 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-21bfa0b1-6132-46f8-9978-6e2b3434f7dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:27.374445 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-21bfa0b1-6132-46f8-9978-6e2b3434f7dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:27.375134 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-21bfa0b1-6132-46f8-9978-6e2b3434f7dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:27.376280 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-21bfa0b1-6132-46f8-9978-6e2b3434f7dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:27.376960 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-21bfa0b1-6132-46f8-9978-6e2b3434f7dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:27.377602 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-21bfa0b1-6132-46f8-9978-6e2b3434f7dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:27.531288 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-21bfa0b1-6132-46f8-9978-6e2b3434f7dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:27.540009 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-21bfa0b1-6132-46f8-9978-6e2b3434f7dd tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.186968 Aug 05 20:53:27.541580 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 520/1063] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:27 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:28.564138 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-cef8f1c9-23f1-4c05-a211-f8baf8d8e05f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:28.564781 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-cef8f1c9-23f1-4c05-a211-f8baf8d8e05f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:28.573547 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cef8f1c9-23f1-4c05-a211-f8baf8d8e05f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:28.574082 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cef8f1c9-23f1-4c05-a211-f8baf8d8e05f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:28.574563 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cef8f1c9-23f1-4c05-a211-f8baf8d8e05f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:28.575266 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cef8f1c9-23f1-4c05-a211-f8baf8d8e05f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:28.575783 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cef8f1c9-23f1-4c05-a211-f8baf8d8e05f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:28.576205 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-cef8f1c9-23f1-4c05-a211-f8baf8d8e05f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:28.733620 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-cef8f1c9-23f1-4c05-a211-f8baf8d8e05f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:28.741864 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-cef8f1c9-23f1-4c05-a211-f8baf8d8e05f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.181872 Aug 05 20:53:28.741864 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 544/1064] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:28 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:53:29.764045 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-abd7325b-b259-4e84-9d80-b1a6892ef7fb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:29.764748 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-abd7325b-b259-4e84-9d80-b1a6892ef7fb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:29.781156 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-abd7325b-b259-4e84-9d80-b1a6892ef7fb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:29.781523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-abd7325b-b259-4e84-9d80-b1a6892ef7fb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:29.782479 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-abd7325b-b259-4e84-9d80-b1a6892ef7fb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:29.783901 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-abd7325b-b259-4e84-9d80-b1a6892ef7fb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:29.784714 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-abd7325b-b259-4e84-9d80-b1a6892ef7fb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:29.785349 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-abd7325b-b259-4e84-9d80-b1a6892ef7fb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:29.952325 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-abd7325b-b259-4e84-9d80-b1a6892ef7fb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:29.962955 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-abd7325b-b259-4e84-9d80-b1a6892ef7fb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.204594 Aug 05 20:53:29.963896 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 521/1065] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:29 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:30.715651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-a493f389-b96c-4c1f-bff3-8d8bec2dcdca req-7d06a87c-a39b-41da-aa2e-be90d220572a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a51e9e-bda8-4c1b-a205-09c067b141b5", "name": "network-vif-plugged", "status": "completed", "tag": "0e53e907-d068-4686-8b1f-9791b78869fa"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:53:30.726533 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a493f389-b96c-4c1f-bff3-8d8bec2dcdca req-7d06a87c-a39b-41da-aa2e-be90d220572a service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:30.727026 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a493f389-b96c-4c1f-bff3-8d8bec2dcdca req-7d06a87c-a39b-41da-aa2e-be90d220572a service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:30.727493 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-a493f389-b96c-4c1f-bff3-8d8bec2dcdca req-7d06a87c-a39b-41da-aa2e-be90d220572a service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:30.739211 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-a493f389-b96c-4c1f-bff3-8d8bec2dcdca req-7d06a87c-a39b-41da-aa2e-be90d220572a service nova] Creating event network-vif-plugged:0e53e907-d068-4686-8b1f-9791b78869fa for instance 61a51e9e-bda8-4c1b-a205-09c067b141b5 on hv-cinder-85220 Aug 05 20:53:30.744307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-a493f389-b96c-4c1f-bff3-8d8bec2dcdca req-7d06a87c-a39b-41da-aa2e-be90d220572a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032841 Aug 05 20:53:30.744937 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 545/1066] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:53:30.986152 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9b6ed791-2fe3-4882-ab72-5604f4b0b89a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:30.987120 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9b6ed791-2fe3-4882-ab72-5604f4b0b89a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:30.994796 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9b6ed791-2fe3-4882-ab72-5604f4b0b89a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:30.995321 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9b6ed791-2fe3-4882-ab72-5604f4b0b89a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:30.995802 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9b6ed791-2fe3-4882-ab72-5604f4b0b89a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:30.996575 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9b6ed791-2fe3-4882-ab72-5604f4b0b89a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:30.997278 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9b6ed791-2fe3-4882-ab72-5604f4b0b89a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:30.997677 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9b6ed791-2fe3-4882-ab72-5604f4b0b89a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:31.172843 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-9b6ed791-2fe3-4882-ab72-5604f4b0b89a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:31.185932 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9b6ed791-2fe3-4882-ab72-5604f4b0b89a tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.204819 Aug 05 20:53:31.186895 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 522/1067] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:30 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:32.215182 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-62e11405-b169-4f89-9df1-53cd687f5668 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:32.215952 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-62e11405-b169-4f89-9df1-53cd687f5668 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:32.222313 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62e11405-b169-4f89-9df1-53cd687f5668 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:32.222786 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62e11405-b169-4f89-9df1-53cd687f5668 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:32.223233 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62e11405-b169-4f89-9df1-53cd687f5668 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:32.223954 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62e11405-b169-4f89-9df1-53cd687f5668 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:32.224407 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62e11405-b169-4f89-9df1-53cd687f5668 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:32.224869 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-62e11405-b169-4f89-9df1-53cd687f5668 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:32.379849 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-62e11405-b169-4f89-9df1-53cd687f5668 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:32.390188 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-62e11405-b169-4f89-9df1-53cd687f5668 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.181769 Aug 05 20:53:32.390766 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 546/1068] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:32 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:33.415952 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f1779d58-9d7b-40eb-a967-3ddd85da4673 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:33.416964 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f1779d58-9d7b-40eb-a967-3ddd85da4673 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:33.424534 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1779d58-9d7b-40eb-a967-3ddd85da4673 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:33.425001 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1779d58-9d7b-40eb-a967-3ddd85da4673 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:33.425461 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1779d58-9d7b-40eb-a967-3ddd85da4673 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:33.426165 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1779d58-9d7b-40eb-a967-3ddd85da4673 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:33.426612 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1779d58-9d7b-40eb-a967-3ddd85da4673 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:33.427035 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f1779d58-9d7b-40eb-a967-3ddd85da4673 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:33.576566 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f1779d58-9d7b-40eb-a967-3ddd85da4673 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:33.584598 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f1779d58-9d7b-40eb-a967-3ddd85da4673 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.175284 Aug 05 20:53:33.585197 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 523/1069] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:33 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:34.607986 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-56989a98-1829-46b8-aba3-6a788ceb30ef tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:34.608589 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-56989a98-1829-46b8-aba3-6a788ceb30ef tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:34.615262 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-56989a98-1829-46b8-aba3-6a788ceb30ef tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:34.615793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-56989a98-1829-46b8-aba3-6a788ceb30ef tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:34.616224 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-56989a98-1829-46b8-aba3-6a788ceb30ef tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:34.616906 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-56989a98-1829-46b8-aba3-6a788ceb30ef tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:34.617352 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-56989a98-1829-46b8-aba3-6a788ceb30ef tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:34.617768 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-56989a98-1829-46b8-aba3-6a788ceb30ef tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:34.777846 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-56989a98-1829-46b8-aba3-6a788ceb30ef tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:34.789710 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-56989a98-1829-46b8-aba3-6a788ceb30ef tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1269 microversion: 2.1 time: 0.186123 Aug 05 20:53:34.790426 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 547/1070] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:34 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1269 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:35.267100 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-687238565", "imageRef": "67739c8b-054e-4aee-a441-934403a38c6b", "flavorRef": "452", "networks": [{"uuid": "cc80e71e-a1fe-4e2a-a21d-2281253b4cd1"}]}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:53:35.327794 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.network.neutron [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] validate_networks() for [('cc80e71e-a1fe-4e2a-a21d-2281253b4cd1', None, None, None, None, None)] {{(pid=124431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 20:53:35.712071 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Flavor limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 20:53:35.712796 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Image limits 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 20:53:35.713358 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Flavor pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 20:53:35.714892 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Image pref 0:0:0 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 20:53:35.715562 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.virt.hardware [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 20:53:35.729152 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:35.730223 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:35.730690 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:35.731474 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:35.731931 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:35.732383 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:35.749770 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Getting quotas for project 2508b437eb7248cc96db6094d6ee1bd8. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 20:53:35.753887 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.quota [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Getting quotas for user 5f96ea7de0d74d2393afd458cb6ff74c and project 2508b437eb7248cc96db6094d6ee1bd8. Resources: {'cores', 'instances', 'ram'} {{(pid=124431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 20:53:35.765475 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Going to run 1 instances... {{(pid=124431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 20:53:35.767768 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67739c8b-054e-4aee-a441-934403a38c6b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 20:53:35.811717 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-73995fa4-a081-4592-9476-09b21c815c45 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:35.812356 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-73995fa4-a081-4592-9476-09b21c815c45 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:35.817086 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-9c35c4b6-a641-4b9a-873c-8703ef2b55e0 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.553872 Aug 05 20:53:35.817903 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 524/1071] 10.222.0.100 () {60 vars in 1152 bytes} [Fri Aug 5 20:53:35 2022] POST /compute/v2.1/servers => generated 382 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 05 20:53:35.827374 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73995fa4-a081-4592-9476-09b21c815c45 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:35.828118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73995fa4-a081-4592-9476-09b21c815c45 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:35.828632 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73995fa4-a081-4592-9476-09b21c815c45 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:35.828756 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-bf14fc9f-d8ca-41b7-adfd-4c90721a9cbd tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:35.829363 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-bf14fc9f-d8ca-41b7-adfd-4c90721a9cbd tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:35.829492 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73995fa4-a081-4592-9476-09b21c815c45 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:35.829964 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73995fa4-a081-4592-9476-09b21c815c45 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:35.830461 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-73995fa4-a081-4592-9476-09b21c815c45 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:35.913593 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-bf14fc9f-d8ca-41b7-adfd-4c90721a9cbd tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:35.921536 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-bf14fc9f-d8ca-41b7-adfd-4c90721a9cbd tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 200 len: 1222 microversion: 2.1 time: 0.096599 Aug 05 20:53:35.922916 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 525/1072] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:35 2022] GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:35.989493 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-73995fa4-a081-4592-9476-09b21c815c45 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:35.998142 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-73995fa4-a081-4592-9476-09b21c815c45 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1456 microversion: 2.1 time: 0.190544 Aug 05 20:53:35.998941 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 548/1073] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:35 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1456 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:36.018467 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-5fd21c62-e04f-4239-bc64-4ddd3024bd4f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:36.019098 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-5fd21c62-e04f-4239-bc64-4ddd3024bd4f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:36.026475 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5fd21c62-e04f-4239-bc64-4ddd3024bd4f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:36.026961 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5fd21c62-e04f-4239-bc64-4ddd3024bd4f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:36.027424 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5fd21c62-e04f-4239-bc64-4ddd3024bd4f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:36.028216 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5fd21c62-e04f-4239-bc64-4ddd3024bd4f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:36.028568 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5fd21c62-e04f-4239-bc64-4ddd3024bd4f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:36.028985 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-5fd21c62-e04f-4239-bc64-4ddd3024bd4f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:36.173017 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-5fd21c62-e04f-4239-bc64-4ddd3024bd4f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:36.181361 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-5fd21c62-e04f-4239-bc64-4ddd3024bd4f tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1456 microversion: 2.1 time: 0.166699 Aug 05 20:53:36.182096 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 526/1074] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:36 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1456 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:36.943639 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-b6b4e86e-3a7b-4e64-87b8-016d08cf965f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:36.944966 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-b6b4e86e-3a7b-4e64-87b8-016d08cf965f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:36.953884 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6b4e86e-3a7b-4e64-87b8-016d08cf965f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:36.955420 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6b4e86e-3a7b-4e64-87b8-016d08cf965f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:36.955859 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6b4e86e-3a7b-4e64-87b8-016d08cf965f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:36.956644 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6b4e86e-3a7b-4e64-87b8-016d08cf965f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:36.957646 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6b4e86e-3a7b-4e64-87b8-016d08cf965f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:36.958334 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-b6b4e86e-3a7b-4e64-87b8-016d08cf965f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:37.036829 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-b6b4e86e-3a7b-4e64-87b8-016d08cf965f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:37.046132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-b6b4e86e-3a7b-4e64-87b8-016d08cf965f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 200 len: 1280 microversion: 2.1 time: 0.107825 Aug 05 20:53:37.051446 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 549/1075] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:36 2022] GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 1280 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:38.030991 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-fc8fc1f1-5f24-4b62-acb4-898545895afc req-90204f4f-11cf-4739-97bc-e109662dc17c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a51e9e-bda8-4c1b-a205-09c067b141b5", "tag": "0e53e907-d068-4686-8b1f-9791b78869fa"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:53:38.042107 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-fc8fc1f1-5f24-4b62-acb4-898545895afc req-90204f4f-11cf-4739-97bc-e109662dc17c service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:38.042802 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-fc8fc1f1-5f24-4b62-acb4-898545895afc req-90204f4f-11cf-4739-97bc-e109662dc17c service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:38.043492 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-fc8fc1f1-5f24-4b62-acb4-898545895afc req-90204f4f-11cf-4739-97bc-e109662dc17c service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:38.060002 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-fc8fc1f1-5f24-4b62-acb4-898545895afc req-90204f4f-11cf-4739-97bc-e109662dc17c service nova] Creating event network-changed:0e53e907-d068-4686-8b1f-9791b78869fa for instance 61a51e9e-bda8-4c1b-a205-09c067b141b5 on hv-cinder-85220 Aug 05 20:53:38.069894 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-5d0d5880-34e5-4c4f-a473-5cb32e4c0b88 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:38.070514 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-5d0d5880-34e5-4c4f-a473-5cb32e4c0b88 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:38.078721 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d0d5880-34e5-4c4f-a473-5cb32e4c0b88 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:38.080668 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-fc8fc1f1-5f24-4b62-acb4-898545895afc req-90204f4f-11cf-4739-97bc-e109662dc17c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053339 Aug 05 20:53:38.081474 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 527/1076] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:53:38.082184 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d0d5880-34e5-4c4f-a473-5cb32e4c0b88 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:38.082985 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d0d5880-34e5-4c4f-a473-5cb32e4c0b88 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:38.084057 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d0d5880-34e5-4c4f-a473-5cb32e4c0b88 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:38.084440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d0d5880-34e5-4c4f-a473-5cb32e4c0b88 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:38.084798 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-5d0d5880-34e5-4c4f-a473-5cb32e4c0b88 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:38.301465 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-2be0b794-f45c-420b-b105-428826b88a5a req-db4634a3-b250-4c92-943f-44ed85474eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c550cb-b280-4c6d-851f-31986ebb3002", "tag": "e53618eb-b206-42a7-b25d-3f5aa7414b8c"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:53:38.312197 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-2be0b794-f45c-420b-b105-428826b88a5a req-db4634a3-b250-4c92-943f-44ed85474eb0 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:38.313055 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-2be0b794-f45c-420b-b105-428826b88a5a req-db4634a3-b250-4c92-943f-44ed85474eb0 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:38.313706 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-2be0b794-f45c-420b-b105-428826b88a5a req-db4634a3-b250-4c92-943f-44ed85474eb0 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:38.325289 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-2be0b794-f45c-420b-b105-428826b88a5a req-db4634a3-b250-4c92-943f-44ed85474eb0 service nova] Creating event network-changed:e53618eb-b206-42a7-b25d-3f5aa7414b8c for instance 14c550cb-b280-4c6d-851f-31986ebb3002 on hv-cinder-85220 Aug 05 20:53:38.330164 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-2be0b794-f45c-420b-b105-428826b88a5a req-db4634a3-b250-4c92-943f-44ed85474eb0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032737 Aug 05 20:53:38.330909 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 528/1077] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:53:38.449987 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-5d0d5880-34e5-4c4f-a473-5cb32e4c0b88 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:38.459189 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-5d0d5880-34e5-4c4f-a473-5cb32e4c0b88 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 200 len: 1322 microversion: 2.1 time: 0.394589 Aug 05 20:53:38.460132 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 550/1078] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:38 2022] GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:39.483334 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-d64bd500-5cc4-4d8f-b21c-43edd8aa43a5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:39.483999 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-d64bd500-5cc4-4d8f-b21c-43edd8aa43a5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:39.491633 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d64bd500-5cc4-4d8f-b21c-43edd8aa43a5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:39.492137 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d64bd500-5cc4-4d8f-b21c-43edd8aa43a5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:39.492734 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d64bd500-5cc4-4d8f-b21c-43edd8aa43a5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:39.493453 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d64bd500-5cc4-4d8f-b21c-43edd8aa43a5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:39.493892 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d64bd500-5cc4-4d8f-b21c-43edd8aa43a5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:39.494424 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-d64bd500-5cc4-4d8f-b21c-43edd8aa43a5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:39.513461 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:39.631204 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-d64bd500-5cc4-4d8f-b21c-43edd8aa43a5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:39.639241 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-d64bd500-5cc4-4d8f-b21c-43edd8aa43a5 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 200 len: 1322 microversion: 2.1 time: 0.161510 Aug 05 20:53:39.639835 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 529/1079] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:39 2022] GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:40.661546 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-428080dc-d4de-4b31-8a14-ba5a47a71919 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:40.662273 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-428080dc-d4de-4b31-8a14-ba5a47a71919 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:40.669496 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-428080dc-d4de-4b31-8a14-ba5a47a71919 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:40.669987 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-428080dc-d4de-4b31-8a14-ba5a47a71919 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:40.670425 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-428080dc-d4de-4b31-8a14-ba5a47a71919 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:40.671123 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-428080dc-d4de-4b31-8a14-ba5a47a71919 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:40.671612 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-428080dc-d4de-4b31-8a14-ba5a47a71919 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:40.672040 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-428080dc-d4de-4b31-8a14-ba5a47a71919 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:40.676300 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:40.819509 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-428080dc-d4de-4b31-8a14-ba5a47a71919 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:40.827972 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-428080dc-d4de-4b31-8a14-ba5a47a71919 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 200 len: 1322 microversion: 2.1 time: 0.170415 Aug 05 20:53:40.828558 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 551/1080] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:40 2022] GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:41.854534 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f0762d15-ebcc-4286-8703-34fa9790c1fd tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:41.855568 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f0762d15-ebcc-4286-8703-34fa9790c1fd tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:41.867897 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f0762d15-ebcc-4286-8703-34fa9790c1fd tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:41.868725 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f0762d15-ebcc-4286-8703-34fa9790c1fd tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:41.869455 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f0762d15-ebcc-4286-8703-34fa9790c1fd tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:41.870624 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f0762d15-ebcc-4286-8703-34fa9790c1fd tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:41.871419 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f0762d15-ebcc-4286-8703-34fa9790c1fd tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:41.872163 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f0762d15-ebcc-4286-8703-34fa9790c1fd tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:42.015007 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f0762d15-ebcc-4286-8703-34fa9790c1fd tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:42.022805 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f0762d15-ebcc-4286-8703-34fa9790c1fd tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 200 len: 1322 microversion: 2.1 time: 0.175013 Aug 05 20:53:42.023390 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 530/1081] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:41 2022] GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:43.046134 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-607cf858-2a26-4447-9b2a-3eaaefc8dd55 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:43.046758 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-607cf858-2a26-4447-9b2a-3eaaefc8dd55 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:43.054230 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-607cf858-2a26-4447-9b2a-3eaaefc8dd55 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:43.054723 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-607cf858-2a26-4447-9b2a-3eaaefc8dd55 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:43.055163 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-607cf858-2a26-4447-9b2a-3eaaefc8dd55 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:43.055924 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-607cf858-2a26-4447-9b2a-3eaaefc8dd55 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:43.056381 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-607cf858-2a26-4447-9b2a-3eaaefc8dd55 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:43.056810 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-607cf858-2a26-4447-9b2a-3eaaefc8dd55 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:43.197157 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-607cf858-2a26-4447-9b2a-3eaaefc8dd55 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:43.205810 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-607cf858-2a26-4447-9b2a-3eaaefc8dd55 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 200 len: 1322 microversion: 2.1 time: 0.164028 Aug 05 20:53:43.206438 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 552/1082] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:43 2022] GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:44.231234 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8b24ded3-be1d-45df-847c-6d08d30a1d45 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:44.232330 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8b24ded3-be1d-45df-847c-6d08d30a1d45 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:44.244156 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8b24ded3-be1d-45df-847c-6d08d30a1d45 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:44.244976 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8b24ded3-be1d-45df-847c-6d08d30a1d45 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:44.245707 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8b24ded3-be1d-45df-847c-6d08d30a1d45 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:44.246861 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8b24ded3-be1d-45df-847c-6d08d30a1d45 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:44.247695 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8b24ded3-be1d-45df-847c-6d08d30a1d45 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:44.248419 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8b24ded3-be1d-45df-847c-6d08d30a1d45 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:44.386512 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-8b24ded3-be1d-45df-847c-6d08d30a1d45 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:44.394624 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8b24ded3-be1d-45df-847c-6d08d30a1d45 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 200 len: 1322 microversion: 2.1 time: 0.170496 Aug 05 20:53:44.395200 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 531/1083] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:44 2022] GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:44.759152 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-730f094e-a216-4227-8d47-3464c7a4628d req-69639b91-04e4-459d-8b61-5559691109c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c550cb-b280-4c6d-851f-31986ebb3002", "name": "network-vif-plugged", "status": "completed", "tag": "e53618eb-b206-42a7-b25d-3f5aa7414b8c"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:53:44.770293 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-730f094e-a216-4227-8d47-3464c7a4628d req-69639b91-04e4-459d-8b61-5559691109c6 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:44.771581 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-730f094e-a216-4227-8d47-3464c7a4628d req-69639b91-04e4-459d-8b61-5559691109c6 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:44.772012 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-730f094e-a216-4227-8d47-3464c7a4628d req-69639b91-04e4-459d-8b61-5559691109c6 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:44.786880 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-730f094e-a216-4227-8d47-3464c7a4628d req-69639b91-04e4-459d-8b61-5559691109c6 service nova] Creating event network-vif-plugged:e53618eb-b206-42a7-b25d-3f5aa7414b8c for instance 14c550cb-b280-4c6d-851f-31986ebb3002 on hv-cinder-85220 Aug 05 20:53:44.792574 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-730f094e-a216-4227-8d47-3464c7a4628d req-69639b91-04e4-459d-8b61-5559691109c6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036807 Aug 05 20:53:44.793191 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 553/1084] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:53:45.417712 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f450eb9a-5d3b-42f6-a0d6-8e7c86789c3f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:45.418489 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f450eb9a-5d3b-42f6-a0d6-8e7c86789c3f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:45.421526 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:45.428708 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f450eb9a-5d3b-42f6-a0d6-8e7c86789c3f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:45.429344 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f450eb9a-5d3b-42f6-a0d6-8e7c86789c3f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:45.429920 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f450eb9a-5d3b-42f6-a0d6-8e7c86789c3f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:45.431212 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f450eb9a-5d3b-42f6-a0d6-8e7c86789c3f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:45.431751 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f450eb9a-5d3b-42f6-a0d6-8e7c86789c3f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:45.432316 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f450eb9a-5d3b-42f6-a0d6-8e7c86789c3f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:45.571635 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-f450eb9a-5d3b-42f6-a0d6-8e7c86789c3f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:45.579483 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f450eb9a-5d3b-42f6-a0d6-8e7c86789c3f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 200 len: 1322 microversion: 2.1 time: 0.166964 Aug 05 20:53:45.580067 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 532/1085] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:45 2022] GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:46.601229 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-ffd05ec3-4664-42e6-9c0d-8004e1880348 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:53:46.601947 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-ffd05ec3-4664-42e6-9c0d-8004e1880348 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:46.604405 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:46.610100 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ffd05ec3-4664-42e6-9c0d-8004e1880348 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:46.610590 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ffd05ec3-4664-42e6-9c0d-8004e1880348 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:46.611028 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ffd05ec3-4664-42e6-9c0d-8004e1880348 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:46.611771 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ffd05ec3-4664-42e6-9c0d-8004e1880348 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:46.612223 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ffd05ec3-4664-42e6-9c0d-8004e1880348 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:46.612678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-ffd05ec3-4664-42e6-9c0d-8004e1880348 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:46.752797 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-ffd05ec3-4664-42e6-9c0d-8004e1880348 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:53:46.760479 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-ffd05ec3-4664-42e6-9c0d-8004e1880348 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 200 len: 1511 microversion: 2.1 time: 0.163628 Aug 05 20:53:46.761036 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 554/1086] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:53:46 2022] GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:53:46.782461 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-3ff34f81-fcc3-48bd-831b-8ab79e9be5ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "630a9612-8c8c-4082-bca1-d325206aa856", "device": "/dev/sdb"}} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:53:46.787315 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-3ff34f81-fcc3-48bd-831b-8ab79e9be5ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:53:46.790199 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=2 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:46.790877 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell0:SELECT=8 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:53:46.798469 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3ff34f81-fcc3-48bd-831b-8ab79e9be5ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:46.798960 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3ff34f81-fcc3-48bd-831b-8ab79e9be5ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:46.799385 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3ff34f81-fcc3-48bd-831b-8ab79e9be5ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:46.800087 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3ff34f81-fcc3-48bd-831b-8ab79e9be5ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:53:46.800534 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3ff34f81-fcc3-48bd-831b-8ab79e9be5ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:53:46.800947 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-3ff34f81-fcc3-48bd-831b-8ab79e9be5ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:53:47.065598 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-3ff34f81-fcc3-48bd-831b-8ab79e9be5ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "POST /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287383 Aug 05 20:53:47.066402 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 533/1087] 10.222.0.100 () {60 vars in 1328 bytes} [Fri Aug 5 20:53:46 2022] POST /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:54:06.610320 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:54:06.611118 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Fri Aug 5 20:54:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:54:06.631760 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-52ca4e95-51bf-4f7b-911a-f0aedeecff8f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:54:06.632260 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-52ca4e95-51bf-4f7b-911a-f0aedeecff8f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:54:06.634559 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:54:06.635232 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=18 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:54:06.641561 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52ca4e95-51bf-4f7b-911a-f0aedeecff8f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:54:06.642047 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52ca4e95-51bf-4f7b-911a-f0aedeecff8f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:54:06.642485 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52ca4e95-51bf-4f7b-911a-f0aedeecff8f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:54:06.643178 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52ca4e95-51bf-4f7b-911a-f0aedeecff8f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:54:06.643658 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52ca4e95-51bf-4f7b-911a-f0aedeecff8f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:54:06.644079 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-52ca4e95-51bf-4f7b-911a-f0aedeecff8f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:54:06.944081 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.objects.instance [None req-52ca4e95-51bf-4f7b-911a-f0aedeecff8f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lazy-loading 'services' on Instance uuid 14c550cb-b280-4c6d-851f-31986ebb3002 {{(pid=124432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:54:07.019592 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-52ca4e95-51bf-4f7b-911a-f0aedeecff8f tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "DELETE /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002/os-volume_attachments/630a9612-8c8c-4082-bca1-d325206aa856" status: 202 len: 0 microversion: 2.1 time: 0.391616 Aug 05 20:54:07.020363 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 555/1088] 10.222.0.100 () {58 vars in 1421 bytes} [Fri Aug 5 20:54:06 2022] DELETE /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002/os-volume_attachments/630a9612-8c8c-4082-bca1-d325206aa856 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:54:08.160516 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=3 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:54:08.161334 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:54:08.166031 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-a876dc61-4ba7-4177-9738-02cbeb446cd8 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:54:08.166621 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a876dc61-4ba7-4177-9738-02cbeb446cd8 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:54:08.174101 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a876dc61-4ba7-4177-9738-02cbeb446cd8 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:54:08.174619 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a876dc61-4ba7-4177-9738-02cbeb446cd8 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:54:08.175172 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a876dc61-4ba7-4177-9738-02cbeb446cd8 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:54:08.175926 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a876dc61-4ba7-4177-9738-02cbeb446cd8 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:54:08.176383 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a876dc61-4ba7-4177-9738-02cbeb446cd8 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:54:08.176812 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-a876dc61-4ba7-4177-9738-02cbeb446cd8 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:54:08.204570 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-a876dc61-4ba7-4177-9738-02cbeb446cd8 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Going to try to terminate instance {{(pid=124431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:54:08.286994 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-a876dc61-4ba7-4177-9738-02cbeb446cd8 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "DELETE /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 204 len: 0 microversion: 2.1 time: 0.128076 Aug 05 20:54:08.287668 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 534/1089] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:54:08 2022] DELETE /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:54:08.297996 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-d63c6beb-5c5e-4be3-99c7-a8f4083982ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:54:08.298700 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-d63c6beb-5c5e-4be3-99c7-a8f4083982ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:54:08.305319 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d63c6beb-5c5e-4be3-99c7-a8f4083982ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:54:08.306028 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d63c6beb-5c5e-4be3-99c7-a8f4083982ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:54:08.306793 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d63c6beb-5c5e-4be3-99c7-a8f4083982ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:54:08.307504 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d63c6beb-5c5e-4be3-99c7-a8f4083982ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:54:08.307962 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d63c6beb-5c5e-4be3-99c7-a8f4083982ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:54:08.308383 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-d63c6beb-5c5e-4be3-99c7-a8f4083982ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:54:08.451714 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-d63c6beb-5c5e-4be3-99c7-a8f4083982ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:54:08.459481 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-d63c6beb-5c5e-4be3-99c7-a8f4083982ec tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 200 len: 1517 microversion: 2.1 time: 0.166198 Aug 05 20:54:08.460084 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 556/1090] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:54:08 2022] GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:54:09.481182 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-69d06de8-6f94-46c8-bb1b-a99a5a9975de tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:54:09.481937 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-69d06de8-6f94-46c8-bb1b-a99a5a9975de tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:54:09.489044 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-69d06de8-6f94-46c8-bb1b-a99a5a9975de tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:54:09.489540 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-69d06de8-6f94-46c8-bb1b-a99a5a9975de tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:54:09.489982 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-69d06de8-6f94-46c8-bb1b-a99a5a9975de tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:54:09.490688 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-69d06de8-6f94-46c8-bb1b-a99a5a9975de tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:54:09.491154 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-69d06de8-6f94-46c8-bb1b-a99a5a9975de tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:54:09.491615 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-69d06de8-6f94-46c8-bb1b-a99a5a9975de tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:54:09.679780 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-69d06de8-6f94-46c8-bb1b-a99a5a9975de tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:54:09.688870 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-69d06de8-6f94-46c8-bb1b-a99a5a9975de tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 200 len: 1517 microversion: 2.1 time: 0.212090 Aug 05 20:54:09.689442 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 535/1091] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:54:09 2022] GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 1517 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:54:10.532025 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-40dfe565-e2a0-4f86-b050-6db5b26d55b3 req-2a01ce9a-ef2b-4eae-80c9-8e9f797beb26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c550cb-b280-4c6d-851f-31986ebb3002", "name": "network-vif-deleted", "tag": "e53618eb-b206-42a7-b25d-3f5aa7414b8c"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:54:10.542748 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-40dfe565-e2a0-4f86-b050-6db5b26d55b3 req-2a01ce9a-ef2b-4eae-80c9-8e9f797beb26 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:54:10.543228 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-40dfe565-e2a0-4f86-b050-6db5b26d55b3 req-2a01ce9a-ef2b-4eae-80c9-8e9f797beb26 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:54:10.543690 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-40dfe565-e2a0-4f86-b050-6db5b26d55b3 req-2a01ce9a-ef2b-4eae-80c9-8e9f797beb26 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:54:10.554972 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-40dfe565-e2a0-4f86-b050-6db5b26d55b3 req-2a01ce9a-ef2b-4eae-80c9-8e9f797beb26 service nova] Creating event network-vif-deleted:e53618eb-b206-42a7-b25d-3f5aa7414b8c for instance 14c550cb-b280-4c6d-851f-31986ebb3002 on hv-cinder-85220 Aug 05 20:54:10.560845 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-40dfe565-e2a0-4f86-b050-6db5b26d55b3 req-2a01ce9a-ef2b-4eae-80c9-8e9f797beb26 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032547 Aug 05 20:54:10.564579 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 557/1092] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:54:10.710432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-4f4bd6e1-796f-4376-8e42-165bac4d3013 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:54:10.711050 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-4f4bd6e1-796f-4376-8e42-165bac4d3013 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:54:10.717783 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4f4bd6e1-796f-4376-8e42-165bac4d3013 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:54:10.718299 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4f4bd6e1-796f-4376-8e42-165bac4d3013 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:54:10.718735 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4f4bd6e1-796f-4376-8e42-165bac4d3013 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:54:10.719454 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4f4bd6e1-796f-4376-8e42-165bac4d3013 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:54:10.719917 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4f4bd6e1-796f-4376-8e42-165bac4d3013 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:54:10.720343 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4f4bd6e1-796f-4376-8e42-165bac4d3013 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:54:10.752167 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4f4bd6e1-796f-4376-8e42-165bac4d3013 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:54:10.752652 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4f4bd6e1-796f-4376-8e42-165bac4d3013 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:54:10.753087 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-4f4bd6e1-796f-4376-8e42-165bac4d3013 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:54:10.753540 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.objects.instance [None req-4f4bd6e1-796f-4376-8e42-165bac4d3013 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lazy-loading 'fault' on Instance uuid 14c550cb-b280-4c6d-851f-31986ebb3002 {{(pid=124431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 20:54:10.805700 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-4f4bd6e1-796f-4376-8e42-165bac4d3013 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f96ea7de0d74d2393afd458cb6ff74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2508b437eb7248cc96db6094d6ee1bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:54:10.816673 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-4f4bd6e1-796f-4376-8e42-165bac4d3013 tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 200 len: 1312 microversion: 2.1 time: 0.110011 Aug 05 20:54:10.817458 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 536/1093] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:54:10 2022] GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:54:11.844366 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-44c05f05-e059-484b-b453-88c90abaf9bf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:54:11.845169 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-44c05f05-e059-484b-b453-88c90abaf9bf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] [instance: 14c550cb-b280-4c6d-851f-31986ebb3002] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:54:11.852801 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-44c05f05-e059-484b-b453-88c90abaf9bf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:54:11.853339 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-44c05f05-e059-484b-b453-88c90abaf9bf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:54:11.853812 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-44c05f05-e059-484b-b453-88c90abaf9bf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:54:11.854791 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-44c05f05-e059-484b-b453-88c90abaf9bf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:54:11.855326 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-44c05f05-e059-484b-b453-88c90abaf9bf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:54:11.855821 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-44c05f05-e059-484b-b453-88c90abaf9bf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:54:11.871451 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-44c05f05-e059-484b-b453-88c90abaf9bf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] HTTP exception thrown: Instance 14c550cb-b280-4c6d-851f-31986ebb3002 could not be found. Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-44c05f05-e059-484b-b453-88c90abaf9bf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Request method failure captured: Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 HTTP/1.1 Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YLvM7Wt4OohbutPF5edqRI2S_PMkT3mEkABHdpbJwoDRnPjyJkLBdxLxtkXB6yM1rkE7grcCe_Lf_GEJYOLXoGl2YVzM4YpzYUJI5BMvJwVagobKPYNo8fmuVVCghMxYAntFzo6_4_fI-k5NDMv8CUo0HdqtonGkG-A4YJqsy3QPEI Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: 2508b437eb7248cc96db6094d6ee1bd8 Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1679724835 Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:54:11.873090 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:54:11.874750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2508b437eb7248cc96db6094d6ee1bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/2508b437eb7248cc96db6094d6ee1bd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/2508b437eb7248cc96db6094d6ee1bd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_2508b437eb7248cc96db6094d6ee1bd8", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:54:11.874750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-VolumesSnapshotTestJSON-1679724835 Aug 05 20:54:11.874750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: 2508b437eb7248cc96db6094d6ee1bd8 Aug 05 20:54:11.874750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1679724835 Aug 05 20:54:11.874750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-VolumesSnapshotTestJSON-1679724835-project Aug 05 20:54:11.874750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:54:11.874750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:54:11.874750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 5f96ea7de0d74d2393afd458cb6ff74c Aug 05 20:54:11.874750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-VolumesSnapshotTestJSON-1679724835-project Aug 05 20:54:11.874750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:54:11.874750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance 14c550cb-b280-4c6d-851f-31986ebb3002 could not be found. Aug 05 20:54:11.874750 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '14c550cb-b280-4c6d-851f-31986ebb3002'} Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14c550cb-b280-4c6d-851f-31986ebb3002 could not be found. Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:54:11.875788 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14c550cb-b280-4c6d-851f-31986ebb3002 could not be found. Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14c550cb-b280-4c6d-851f-31986ebb3002 could not be found. Aug 05 20:54:11.877386 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:54:11.878647 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-44c05f05-e059-484b-b453-88c90abaf9bf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] Returning 404 to user: Instance 14c550cb-b280-4c6d-851f-31986ebb3002 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:54:11.878647 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-44c05f05-e059-484b-b453-88c90abaf9bf tempest-VolumesSnapshotTestJSON-1679724835 tempest-VolumesSnapshotTestJSON-1679724835-project] 10.222.0.100 "GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002" status: 404 len: 111 microversion: 2.1 time: 0.036952 Aug 05 20:54:11.878647 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 558/1094] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:54:11 2022] GET /compute/v2.1/servers/14c550cb-b280-4c6d-851f-31986ebb3002 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:54:18.545961 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:54:18.546648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Fri Aug 5 20:54:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:55:27.914625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:55:27.915971 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG dbcounter [-] [124431] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:55:27.920237 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-8f4b6b45-1479-45d3-9b0b-942c1ef14ed9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:55:27.920745 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8f4b6b45-1479-45d3-9b0b-942c1ef14ed9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:55:27.921342 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_api:SELECT=8 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:55:27.922101 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG dbcounter [-] [124432] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 20:55:27.927404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8f4b6b45-1479-45d3-9b0b-942c1ef14ed9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:27.927906 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8f4b6b45-1479-45d3-9b0b-942c1ef14ed9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:27.928361 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8f4b6b45-1479-45d3-9b0b-942c1ef14ed9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:27.929111 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8f4b6b45-1479-45d3-9b0b-942c1ef14ed9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:27.929573 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8f4b6b45-1479-45d3-9b0b-942c1ef14ed9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:27.930009 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-8f4b6b45-1479-45d3-9b0b-942c1ef14ed9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:27.959644 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-8f4b6b45-1479-45d3-9b0b-942c1ef14ed9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Going to try to terminate instance {{(pid=124431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:55:28.053134 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-8f4b6b45-1479-45d3-9b0b-942c1ef14ed9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "DELETE /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 204 len: 0 microversion: 2.1 time: 0.140566 Aug 05 20:55:28.056730 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 537/1095] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:55:27 2022] DELETE /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:55:28.071676 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-73ae1c1d-345d-4e45-b686-218a9a8fc078 req-f7d48be4-b187-4bdd-9ef3-81ca59e7b9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a51e9e-bda8-4c1b-a205-09c067b141b5", "tag": "0e53e907-d068-4686-8b1f-9791b78869fa"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:55:28.071870 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-91d0f929-c508-450d-98c3-6be8335278df tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:55:28.072762 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-91d0f929-c508-450d-98c3-6be8335278df tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:55:28.079596 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91d0f929-c508-450d-98c3-6be8335278df tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:28.080109 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91d0f929-c508-450d-98c3-6be8335278df tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:28.080924 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91d0f929-c508-450d-98c3-6be8335278df tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:28.081474 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91d0f929-c508-450d-98c3-6be8335278df tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:28.081624 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-73ae1c1d-345d-4e45-b686-218a9a8fc078 req-f7d48be4-b187-4bdd-9ef3-81ca59e7b9e7 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:28.081999 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91d0f929-c508-450d-98c3-6be8335278df tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:28.082432 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-91d0f929-c508-450d-98c3-6be8335278df tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:28.082558 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-73ae1c1d-345d-4e45-b686-218a9a8fc078 req-f7d48be4-b187-4bdd-9ef3-81ca59e7b9e7 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:28.082992 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-73ae1c1d-345d-4e45-b686-218a9a8fc078 req-f7d48be4-b187-4bdd-9ef3-81ca59e7b9e7 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:28.095440 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-73ae1c1d-345d-4e45-b686-218a9a8fc078 req-f7d48be4-b187-4bdd-9ef3-81ca59e7b9e7 service nova] Creating event network-changed:0e53e907-d068-4686-8b1f-9791b78869fa for instance 61a51e9e-bda8-4c1b-a205-09c067b141b5 on hv-cinder-85220 Aug 05 20:55:28.100732 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-73ae1c1d-345d-4e45-b686-218a9a8fc078 req-f7d48be4-b187-4bdd-9ef3-81ca59e7b9e7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185777 Aug 05 20:55:28.104736 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 559/1096] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:55:28.224218 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-91d0f929-c508-450d-98c3-6be8335278df tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:55:28.232290 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-91d0f929-c508-450d-98c3-6be8335278df tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1581 microversion: 2.1 time: 0.172198 Aug 05 20:55:28.232861 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 538/1097] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:55:28 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1581 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:55:29.257683 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-4e0b9074-edbd-4a4e-9038-1ee592ba42d0 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:55:29.258407 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-4e0b9074-edbd-4a4e-9038-1ee592ba42d0 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:55:29.265306 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e0b9074-edbd-4a4e-9038-1ee592ba42d0 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:29.265787 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e0b9074-edbd-4a4e-9038-1ee592ba42d0 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:29.266222 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e0b9074-edbd-4a4e-9038-1ee592ba42d0 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:29.266909 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e0b9074-edbd-4a4e-9038-1ee592ba42d0 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:29.267387 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e0b9074-edbd-4a4e-9038-1ee592ba42d0 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:29.267812 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-4e0b9074-edbd-4a4e-9038-1ee592ba42d0 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:29.491129 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-4e0b9074-edbd-4a4e-9038-1ee592ba42d0 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:55:29.502725 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-4e0b9074-edbd-4a4e-9038-1ee592ba42d0 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1581 microversion: 2.1 time: 0.250100 Aug 05 20:55:29.503295 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 560/1098] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:55:29 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1581 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:55:30.531775 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-e90254bb-0c2c-4209-85de-c874358b1ae5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:55:30.532551 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-e90254bb-0c2c-4209-85de-c874358b1ae5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:55:30.539571 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e90254bb-0c2c-4209-85de-c874358b1ae5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:30.540288 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e90254bb-0c2c-4209-85de-c874358b1ae5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:30.540483 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e90254bb-0c2c-4209-85de-c874358b1ae5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:30.541176 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e90254bb-0c2c-4209-85de-c874358b1ae5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:30.541614 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e90254bb-0c2c-4209-85de-c874358b1ae5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:30.542046 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-e90254bb-0c2c-4209-85de-c874358b1ae5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:30.566287 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-6be1aa2c-af99-4d75-812e-82d38e9b9075 req-e53dcd86-b9d5-481f-92ee-1a9f1f318087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a51e9e-bda8-4c1b-a205-09c067b141b5", "name": "network-vif-deleted", "tag": "0e53e907-d068-4686-8b1f-9791b78869fa"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:55:30.578994 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-6be1aa2c-af99-4d75-812e-82d38e9b9075 req-e53dcd86-b9d5-481f-92ee-1a9f1f318087 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:30.579521 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-6be1aa2c-af99-4d75-812e-82d38e9b9075 req-e53dcd86-b9d5-481f-92ee-1a9f1f318087 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:30.579959 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-6be1aa2c-af99-4d75-812e-82d38e9b9075 req-e53dcd86-b9d5-481f-92ee-1a9f1f318087 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:30.591395 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-6be1aa2c-af99-4d75-812e-82d38e9b9075 req-e53dcd86-b9d5-481f-92ee-1a9f1f318087 service nova] Creating event network-vif-deleted:0e53e907-d068-4686-8b1f-9791b78869fa for instance 61a51e9e-bda8-4c1b-a205-09c067b141b5 on hv-cinder-85220 Aug 05 20:55:30.597143 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-6be1aa2c-af99-4d75-812e-82d38e9b9075 req-e53dcd86-b9d5-481f-92ee-1a9f1f318087 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103956 Aug 05 20:55:30.597826 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 539/1099] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:55:30.611336 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-e90254bb-0c2c-4209-85de-c874358b1ae5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:55:30.619401 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-e90254bb-0c2c-4209-85de-c874358b1ae5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 200 len: 1228 microversion: 2.1 time: 0.093925 Aug 05 20:55:30.619946 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 561/1100] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:55:30 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 20:55:31.650656 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f170f2af-1203-4af7-9a73-064544d329ca tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:55:31.651837 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-f170f2af-1203-4af7-9a73-064544d329ca tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 61a51e9e-bda8-4c1b-a205-09c067b141b5] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:55:31.662435 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f170f2af-1203-4af7-9a73-064544d329ca tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:31.662922 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f170f2af-1203-4af7-9a73-064544d329ca tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:31.663383 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f170f2af-1203-4af7-9a73-064544d329ca tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:31.664094 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f170f2af-1203-4af7-9a73-064544d329ca tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:31.664547 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f170f2af-1203-4af7-9a73-064544d329ca tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:31.664973 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-f170f2af-1203-4af7-9a73-064544d329ca tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:31.683839 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-f170f2af-1203-4af7-9a73-064544d329ca tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] HTTP exception thrown: Instance 61a51e9e-bda8-4c1b-a205-09c067b141b5 could not be found. Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f170f2af-1203-4af7-9a73-064544d329ca tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Request method failure captured: Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 HTTP/1.1 Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YHscrmnsJNJm4x3MPaztFQvEa66JlKQwvTN3gQF-YBIBUWreJH7wNe5Jc3kShKEqwxSAaGQiwbd2g5E1-YlMOSU8ZAOteIncDpRCzpAI1jas8tB3zjOnVdU6iILeB6A5EBIvm_neDEY25RHgzXx3rU3zvqI1IjpmzVWk0Yi2pJ0Vd8 Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: c671352d2d2c475ab5c58932b6ecf5bc Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-TestVolumeBootPattern-882352379 Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:55:31.686267 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:55:31.688102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_c671352d2d2c475ab5c58932b6ecf5bc", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:55:31.688102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-TestVolumeBootPattern-882352379 Aug 05 20:55:31.688102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: c671352d2d2c475ab5c58932b6ecf5bc Aug 05 20:55:31.688102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-TestVolumeBootPattern-882352379 Aug 05 20:55:31.688102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-TestVolumeBootPattern-882352379-project Aug 05 20:55:31.688102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:55:31.688102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:55:31.688102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 9b5ea50e80674c9f96821af04540ba39 Aug 05 20:55:31.688102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-TestVolumeBootPattern-882352379-project Aug 05 20:55:31.688102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:55:31.688102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 61a51e9e-bda8-4c1b-a205-09c067b141b5 could not be found. Aug 05 20:55:31.688102 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '61a51e9e-bda8-4c1b-a205-09c067b141b5'} Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a51e9e-bda8-4c1b-a205-09c067b141b5 could not be found. Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:55:31.689404 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a51e9e-bda8-4c1b-a205-09c067b141b5 could not be found. Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a51e9e-bda8-4c1b-a205-09c067b141b5 could not be found. Aug 05 20:55:31.691429 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:55:31.693033 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-f170f2af-1203-4af7-9a73-064544d329ca tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Returning 404 to user: Instance 61a51e9e-bda8-4c1b-a205-09c067b141b5 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:55:31.693033 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-f170f2af-1203-4af7-9a73-064544d329ca tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5" status: 404 len: 111 microversion: 2.1 time: 0.043781 Aug 05 20:55:31.693033 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 540/1101] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:55:31 2022] GET /compute/v2.1/servers/61a51e9e-bda8-4c1b-a205-09c067b141b5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:55:34.856700 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-1c8ac2c3-ea23-45ec-b72d-52bf3e24d998 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:55:34.857949 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1c8ac2c3-ea23-45ec-b72d-52bf3e24d998 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:55:34.858807 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [req-211dcfa5-afb0-4f9e-9d0d-1d4a57537ff4 req-b20c41e7-3b37-4f65-8b49-e3c45f5506b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce647114-7b2b-4ed1-94c2-93f5f7dface7", "tag": "ac1f9a37-2bdf-419a-83fe-c50df645c906"}]} {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:55:34.865195 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c8ac2c3-ea23-45ec-b72d-52bf3e24d998 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:34.866467 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c8ac2c3-ea23-45ec-b72d-52bf3e24d998 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:34.866908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c8ac2c3-ea23-45ec-b72d-52bf3e24d998 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:34.867677 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c8ac2c3-ea23-45ec-b72d-52bf3e24d998 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:34.868135 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c8ac2c3-ea23-45ec-b72d-52bf3e24d998 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:34.868570 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-1c8ac2c3-ea23-45ec-b72d-52bf3e24d998 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:34.869442 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-211dcfa5-afb0-4f9e-9d0d-1d4a57537ff4 req-b20c41e7-3b37-4f65-8b49-e3c45f5506b7 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:34.870035 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-211dcfa5-afb0-4f9e-9d0d-1d4a57537ff4 req-b20c41e7-3b37-4f65-8b49-e3c45f5506b7 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:34.870561 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [req-211dcfa5-afb0-4f9e-9d0d-1d4a57537ff4 req-b20c41e7-3b37-4f65-8b49-e3c45f5506b7 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:34.885431 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.compute.server_external_events [req-211dcfa5-afb0-4f9e-9d0d-1d4a57537ff4 req-b20c41e7-3b37-4f65-8b49-e3c45f5506b7 service nova] Creating event network-changed:ac1f9a37-2bdf-419a-83fe-c50df645c906 for instance ce647114-7b2b-4ed1-94c2-93f5f7dface7 on hv-cinder-85220 Aug 05 20:55:34.890840 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [req-211dcfa5-afb0-4f9e-9d0d-1d4a57537ff4 req-b20c41e7-3b37-4f65-8b49-e3c45f5506b7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035759 Aug 05 20:55:34.891698 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 541/1102] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:55:34.894662 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-1c8ac2c3-ea23-45ec-b72d-52bf3e24d998 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Going to try to terminate instance {{(pid=124432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 20:55:34.983964 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-1c8ac2c3-ea23-45ec-b72d-52bf3e24d998 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 204 len: 0 microversion: 2.1 time: 0.131207 Aug 05 20:55:34.985015 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 562/1103] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:55:34 2022] DELETE /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 20:55:34.994160 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-6a5428e2-57fb-4606-a422-f1a52c12a372 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:55:34.994881 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-6a5428e2-57fb-4606-a422-f1a52c12a372 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:55:35.002081 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6a5428e2-57fb-4606-a422-f1a52c12a372 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:35.002879 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6a5428e2-57fb-4606-a422-f1a52c12a372 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:35.003574 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6a5428e2-57fb-4606-a422-f1a52c12a372 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:35.004340 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6a5428e2-57fb-4606-a422-f1a52c12a372 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:35.004824 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6a5428e2-57fb-4606-a422-f1a52c12a372 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:35.005262 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-6a5428e2-57fb-4606-a422-f1a52c12a372 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:35.165452 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-6a5428e2-57fb-4606-a422-f1a52c12a372 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:55:35.173851 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-6a5428e2-57fb-4606-a422-f1a52c12a372 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1581 microversion: 2.1 time: 0.184000 Aug 05 20:55:35.174396 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 542/1104] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:55:34 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1581 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:55:36.197458 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-26f7f91e-6286-4d36-b778-069d3f9a5feb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:55:36.198245 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-26f7f91e-6286-4d36-b778-069d3f9a5feb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:55:36.205932 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26f7f91e-6286-4d36-b778-069d3f9a5feb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:36.206526 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26f7f91e-6286-4d36-b778-069d3f9a5feb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:36.206965 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26f7f91e-6286-4d36-b778-069d3f9a5feb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:36.208619 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26f7f91e-6286-4d36-b778-069d3f9a5feb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:36.208619 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26f7f91e-6286-4d36-b778-069d3f9a5feb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:36.208896 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-26f7f91e-6286-4d36-b778-069d3f9a5feb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:36.374797 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.policy [None req-26f7f91e-6286-4d36-b778-069d3f9a5feb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:55:36.382975 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-26f7f91e-6286-4d36-b778-069d3f9a5feb tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1581 microversion: 2.1 time: 0.190572 Aug 05 20:55:36.383584 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 563/1105] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:55:36 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1581 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:55:37.405608 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-20e16fdd-d571-4d83-9836-433cd975d338 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:55:37.406311 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-20e16fdd-d571-4d83-9836-433cd975d338 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:55:37.418645 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20e16fdd-d571-4d83-9836-433cd975d338 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:37.419181 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20e16fdd-d571-4d83-9836-433cd975d338 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:37.419625 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20e16fdd-d571-4d83-9836-433cd975d338 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:37.421926 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20e16fdd-d571-4d83-9836-433cd975d338 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:37.422411 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20e16fdd-d571-4d83-9836-433cd975d338 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:37.422852 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-20e16fdd-d571-4d83-9836-433cd975d338 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:37.468324 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [req-23e1e394-a30e-44ee-a1b5-e6dad8765359 req-1bcfd864-338d-4c8b-b364-5d30204fd928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce647114-7b2b-4ed1-94c2-93f5f7dface7", "name": "network-vif-deleted", "tag": "ac1f9a37-2bdf-419a-83fe-c50df645c906"}]} {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 20:55:37.480213 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-23e1e394-a30e-44ee-a1b5-e6dad8765359 req-1bcfd864-338d-4c8b-b364-5d30204fd928 service nova] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:37.480694 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-23e1e394-a30e-44ee-a1b5-e6dad8765359 req-1bcfd864-338d-4c8b-b364-5d30204fd928 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:37.481418 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [req-23e1e394-a30e-44ee-a1b5-e6dad8765359 req-1bcfd864-338d-4c8b-b364-5d30204fd928 service nova] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:37.494241 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.compute.server_external_events [req-23e1e394-a30e-44ee-a1b5-e6dad8765359 req-1bcfd864-338d-4c8b-b364-5d30204fd928 service nova] Creating event network-vif-deleted:ac1f9a37-2bdf-419a-83fe-c50df645c906 for instance ce647114-7b2b-4ed1-94c2-93f5f7dface7 on hv-cinder-85220 Aug 05 20:55:37.499406 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.policy [None req-20e16fdd-d571-4d83-9836-433cd975d338 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5ea50e80674c9f96821af04540ba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c671352d2d2c475ab5c58932b6ecf5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 20:55:37.499619 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [req-23e1e394-a30e-44ee-a1b5-e6dad8765359 req-1bcfd864-338d-4c8b-b364-5d30204fd928 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034843 Aug 05 20:55:37.500098 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 564/1106] 10.222.0.100 () {64 vars in 1322 bytes} [Fri Aug 5 20:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 20:55:37.508336 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-20e16fdd-d571-4d83-9836-433cd975d338 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 200 len: 1394 microversion: 2.1 time: 0.106769 Aug 05 20:55:37.508906 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 543/1107] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:55:37 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 1394 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 20:55:38.535754 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2ad5df35-239b-4a12-baf5-8b8524dfccb1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:55:38.536978 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-2ad5df35-239b-4a12-baf5-8b8524dfccb1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: ce647114-7b2b-4ed1-94c2-93f5f7dface7] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:55:38.543903 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ad5df35-239b-4a12-baf5-8b8524dfccb1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:38.544383 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ad5df35-239b-4a12-baf5-8b8524dfccb1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:38.544812 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ad5df35-239b-4a12-baf5-8b8524dfccb1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:38.545495 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ad5df35-239b-4a12-baf5-8b8524dfccb1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:38.545942 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ad5df35-239b-4a12-baf5-8b8524dfccb1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:38.546363 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-2ad5df35-239b-4a12-baf5-8b8524dfccb1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:38.560294 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-2ad5df35-239b-4a12-baf5-8b8524dfccb1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] HTTP exception thrown: Instance ce647114-7b2b-4ed1-94c2-93f5f7dface7 could not be found. Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2ad5df35-239b-4a12-baf5-8b8524dfccb1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Request method failure captured: Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 HTTP/1.1 Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YHscrmnsJNJm4x3MPaztFQvEa66JlKQwvTN3gQF-YBIBUWreJH7wNe5Jc3kShKEqwxSAaGQiwbd2g5E1-YlMOSU8ZAOteIncDpRCzpAI1jas8tB3zjOnVdU6iILeB6A5EBIvm_neDEY25RHgzXx3rU3zvqI1IjpmzVWk0Yi2pJ0Vd8 Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: c671352d2d2c475ab5c58932b6ecf5bc Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-TestVolumeBootPattern-882352379 Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:55:38.561908 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:55:38.563617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_c671352d2d2c475ab5c58932b6ecf5bc", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:55:38.563617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-TestVolumeBootPattern-882352379 Aug 05 20:55:38.563617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: c671352d2d2c475ab5c58932b6ecf5bc Aug 05 20:55:38.563617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-TestVolumeBootPattern-882352379 Aug 05 20:55:38.563617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-TestVolumeBootPattern-882352379-project Aug 05 20:55:38.563617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:55:38.563617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:55:38.563617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 9b5ea50e80674c9f96821af04540ba39 Aug 05 20:55:38.563617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-TestVolumeBootPattern-882352379-project Aug 05 20:55:38.563617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:55:38.563617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance ce647114-7b2b-4ed1-94c2-93f5f7dface7 could not be found. Aug 05 20:55:38.563617 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': 'ce647114-7b2b-4ed1-94c2-93f5f7dface7'} Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce647114-7b2b-4ed1-94c2-93f5f7dface7 could not be found. Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:55:38.564651 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce647114-7b2b-4ed1-94c2-93f5f7dface7 could not be found. Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce647114-7b2b-4ed1-94c2-93f5f7dface7 could not be found. Aug 05 20:55:38.566307 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:55:38.567953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-2ad5df35-239b-4a12-baf5-8b8524dfccb1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Returning 404 to user: Instance ce647114-7b2b-4ed1-94c2-93f5f7dface7 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:55:38.567953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-2ad5df35-239b-4a12-baf5-8b8524dfccb1 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7" status: 404 len: 111 microversion: 2.1 time: 0.035677 Aug 05 20:55:38.567953 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 565/1108] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:55:38 2022] GET /compute/v2.1/servers/ce647114-7b2b-4ed1-94c2-93f5f7dface7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:55:39.051933 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ad50dcf7-f14b-448d-a5d0-beb9db65b7d5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:55:39.053012 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.compute.api [None req-ad50dcf7-f14b-448d-a5d0-beb9db65b7d5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:55:39.059715 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad50dcf7-f14b-448d-a5d0-beb9db65b7d5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:39.060205 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad50dcf7-f14b-448d-a5d0-beb9db65b7d5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:39.060640 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad50dcf7-f14b-448d-a5d0-beb9db65b7d5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:39.061329 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad50dcf7-f14b-448d-a5d0-beb9db65b7d5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:39.062109 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad50dcf7-f14b-448d-a5d0-beb9db65b7d5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:39.062566 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG oslo_concurrency.lockutils [None req-ad50dcf7-f14b-448d-a5d0-beb9db65b7d5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:39.078095 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.wsgi [None req-ad50dcf7-f14b-448d-a5d0-beb9db65b7d5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] HTTP exception thrown: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ad50dcf7-f14b-448d-a5d0-beb9db65b7d5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Request method failure captured: Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: request: DELETE /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 HTTP/1.1 Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept: application/json Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Accept-Encoding: identity Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Connection: close Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Length: 0 Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Content-Type: application/json Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Host: 10.222.0.100 Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Openstack-System-Scope: None Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: User-Agent: python-urllib3/1.26.11 Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Auth-Token: gAAAAABi7YHscrmnsJNJm4x3MPaztFQvEa66JlKQwvTN3gQF-YBIBUWreJH7wNe5Jc3kShKEqwxSAaGQiwbd2g5E1-YlMOSU8ZAOteIncDpRCzpAI1jas8tB3zjOnVdU6iILeB6A5EBIvm_neDEY25RHgzXx3rU3zvqI1IjpmzVWk0Yi2pJ0Vd8 Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Id: None Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Domain-Name: None Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Identity-Status: Confirmed Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Is-Admin-Project: True Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Id: default Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Domain-Name: Default Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Id: c671352d2d2c475ab5c58932b6ecf5bc Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Project-Name: tempest-TestVolumeBootPattern-882352379 Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Role: member,reader Aug 05 20:55:39.079801 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Roles: member,reader Aug 05 20:55:39.081523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_c671352d2d2c475ab5c58932b6ecf5bc", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:55:39.081523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant: tempest-TestVolumeBootPattern-882352379 Aug 05 20:55:39.081523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Id: c671352d2d2c475ab5c58932b6ecf5bc Aug 05 20:55:39.081523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-Tenant-Name: tempest-TestVolumeBootPattern-882352379 Aug 05 20:55:39.081523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User: tempest-TestVolumeBootPattern-882352379-project Aug 05 20:55:39.081523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Id: default Aug 05 20:55:39.081523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Domain-Name: Default Aug 05 20:55:39.081523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Id: 9b5ea50e80674c9f96821af04540ba39 Aug 05 20:55:39.081523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: X-User-Name: tempest-TestVolumeBootPattern-882352379-project Aug 05 20:55:39.081523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: method: > Aug 05 20:55:39.081523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: exception: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:55:39.081523 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: action_args: {'id': '70c7ca7c-10a8-4b62-a82e-01b05bd4cf19'} Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:55:39.082375 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:55:39.083823 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: ERROR nova.api.openstack.wsgi Aug 05 20:55:39.086003 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-ad50dcf7-f14b-448d-a5d0-beb9db65b7d5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Returning 404 to user: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. {{(pid=124431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:55:39.086003 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-ad50dcf7-f14b-448d-a5d0-beb9db65b7d5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "DELETE /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 404 len: 111 microversion: 2.1 time: 0.033442 Aug 05 20:55:39.086003 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 544/1109] 10.222.0.100 () {58 vars in 1244 bytes} [Fri Aug 5 20:55:39 2022] DELETE /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:55:39.092127 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c7a0abd5-ba93-429f-a9a9-2079e443d5a5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '>' {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:55:39.092735 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.compute.api [None req-c7a0abd5-ba93-429f-a9a9-2079e443d5a5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] [instance: 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19] Fetching instance by UUID {{(pid=124432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 20:55:39.098823 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7a0abd5-ba93-429f-a9a9-2079e443d5a5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:39.099302 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7a0abd5-ba93-429f-a9a9-2079e443d5a5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:39.099990 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7a0abd5-ba93-429f-a9a9-2079e443d5a5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:39.100678 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7a0abd5-ba93-429f-a9a9-2079e443d5a5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Acquiring lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 20:55:39.101126 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7a0abd5-ba93-429f-a9a9-2079e443d5a5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 20:55:39.101546 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG oslo_concurrency.lockutils [None req-c7a0abd5-ba93-429f-a9a9-2079e443d5a5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Lock "aa2e0ab0-e014-4390-9eb9-f79d2e1db09c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 20:55:39.115220 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.wsgi [None req-c7a0abd5-ba93-429f-a9a9-2079e443d5a5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] HTTP exception thrown: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c7a0abd5-ba93-429f-a9a9-2079e443d5a5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Request method failure captured: Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: request: GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 HTTP/1.1 Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept: application/json Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Accept-Encoding: identity Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Connection: close Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Length: 0 Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Content-Type: application/json Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Host: 10.222.0.100 Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Openstack-System-Scope: None Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: User-Agent: python-urllib3/1.26.11 Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Auth-Token: gAAAAABi7YHscrmnsJNJm4x3MPaztFQvEa66JlKQwvTN3gQF-YBIBUWreJH7wNe5Jc3kShKEqwxSAaGQiwbd2g5E1-YlMOSU8ZAOteIncDpRCzpAI1jas8tB3zjOnVdU6iILeB6A5EBIvm_neDEY25RHgzXx3rU3zvqI1IjpmzVWk0Yi2pJ0Vd8 Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Id: None Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Domain-Name: None Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Identity-Status: Confirmed Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Is-Admin-Project: True Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Id: default Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Domain-Name: Default Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Id: c671352d2d2c475ab5c58932b6ecf5bc Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Project-Name: tempest-TestVolumeBootPattern-882352379 Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Role: member,reader Aug 05 20:55:39.116824 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Roles: member,reader Aug 05 20:55:39.118648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/compute/v2/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/volume/v3/c671352d2d2c475ab5c58932b6ecf5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.100:8080/v1/AUTH_c671352d2d2c475ab5c58932b6ecf5bc", "adminURL": "http://10.222.0.100:8080"}]}] Aug 05 20:55:39.118648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant: tempest-TestVolumeBootPattern-882352379 Aug 05 20:55:39.118648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Id: c671352d2d2c475ab5c58932b6ecf5bc Aug 05 20:55:39.118648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-Tenant-Name: tempest-TestVolumeBootPattern-882352379 Aug 05 20:55:39.118648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User: tempest-TestVolumeBootPattern-882352379-project Aug 05 20:55:39.118648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Id: default Aug 05 20:55:39.118648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Domain-Name: Default Aug 05 20:55:39.118648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Id: 9b5ea50e80674c9f96821af04540ba39 Aug 05 20:55:39.118648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: X-User-Name: tempest-TestVolumeBootPattern-882352379-project Aug 05 20:55:39.118648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: method: > Aug 05 20:55:39.118648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: exception: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:55:39.118648 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: action_args: {'id': '70c7ca7c-10a8-4b62-a82e-01b05bd4cf19'} Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: {{(pid=124432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 20:55:39.119517 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. Aug 05 20:55:39.120900 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: ERROR nova.api.openstack.wsgi Aug 05 20:55:39.122100 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: DEBUG nova.api.openstack.wsgi [None req-c7a0abd5-ba93-429f-a9a9-2079e443d5a5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Returning 404 to user: Instance 70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 could not be found. {{(pid=124432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 20:55:39.122100 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO nova.api.openstack.requestlog [None req-c7a0abd5-ba93-429f-a9a9-2079e443d5a5 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19" status: 404 len: 111 microversion: 2.1 time: 0.031000 Aug 05 20:55:39.122100 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: [pid: 124432|app: 0|req: 566/1110] 10.222.0.100 () {58 vars in 1241 bytes} [Fri Aug 5 20:55:39 2022] GET /compute/v2.1/servers/70c7ca7c-10a8-4b62-a82e-01b05bd4cf19 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 20:55:40.436958 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: DEBUG nova.api.openstack.wsgi [None req-842ef1e0-5bb9-48eb-8ef0-bcf577b653f9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] Calling method '.version_select at 0x7f9be76f81f0>' {{(pid=124431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 20:55:40.460811 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO nova.api.openstack.requestlog [None req-842ef1e0-5bb9-48eb-8ef0-bcf577b653f9 tempest-TestVolumeBootPattern-882352379 tempest-TestVolumeBootPattern-882352379-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1555072571" status: 202 len: 0 microversion: 2.1 time: 0.027693 Aug 05 20:55:40.461394 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: [pid: 124431|app: 0|req: 545/1111] 10.222.0.100 () {58 vars in 1268 bytes} [Fri Aug 5 20:55:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1555072571 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 20:55:58.208196 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:55:58.208952 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Fri Aug 5 20:55:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:57:26.622492 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:57:26.623287 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Fri Aug 5 20:57:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:57:38.556261 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:57:38.557031 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Fri Aug 5 20:57:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:58:08.226577 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:58:08.227181 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Fri Aug 5 20:58:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 20:59:18.217671 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 20:59:18.218356 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Fri Aug 5 20:59:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 21:00:46.633479 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 21:00:46.634470 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Fri Aug 5 21:00:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 21:00:48.626437 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 21:00:48.627489 dv-cinder-852208-3-iscsi devstack@n-api.service[124431]: Fri Aug 5 21:00:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 21:00:58.566628 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 21:00:58.567738 dv-cinder-852208-3-iscsi devstack@n-api.service[124432]: Fri Aug 5 21:00:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!